Skip to content

Sentiment Analyzer

The Sentitment classifier is a tool allowing to classify a document according to 2 classes:NEGATIVE and POSITIVE This tools is a rest service.

Sentiment Analyzer API

Sentiment Analyzer configuration

Example of Configuration:

search.json
{
    "logger": {
        "logging-level":  "info"
    },
    "sentiment": {
        "settings":{
            "use-cuda" : false,
            "cuda-device":0,
            "language":"en",
            "model-path-or-name":"{{ project.path }}/resources/modeling/net"
        },
        "network": {
            "host":"0.0.0.0",
            "port":10009,
            "associate-environment": {
                "host":"SENTIMENT_ANALYSIS_HOST",
                "port":"SENTIMENT_ANALYSIS_PORT"
            }
        },
        "runtime":{
            "request-max-size":100000000,
            "request-buffer-queue-size":100,
            "keep-alive":true,
            "keep-alive-timeout":5,
            "graceful-shutown-timeout":15.0,
            "request-timeout":60,
            "response-timeout":60,
            "workers":1
        }
    }
}

Sentiment Analyzer is an aggreation of network configuration, serialize configuration, runtime configuration (in field converter), logger (at top level).

Configure Sentiment classifier Settings

Settings (in field sentiment) allows to configure some default behaviours of sentiment:

  • settings/language: define language [en | fr]
  • settings/use-cuda: use cuda device
  • settings/cuda-device: device number (multiple graphic cards)

Configure Sentiment classifier logger

Logger is configuration at top level of json in logger field.

Example of Configuration:

logger configuration
{
    "logger": {
        "logging-level": "debug"
    }    
}

The logger fields is:

  • logging-level

It can be set to the following values:

  • debug for the debug level and developper information
  • info for the level of information
  • warning to display only warning and errors
  • error to display only error
  • critical to display only error

Configure Sentiment classifier Network

Example of Configuration:

network configuration
{
    "network": {
        "host":"0.0.0.0",
        "port":8080,
        "associate-environment": {
            "host":"HOST_ENVNAME",
            "port":"PORT_ENVNAME"
        },
        "ssl":
        {
            "certificate":"path/to/certificate",
            "key":"path/to/key"
        }
    }
}

The network fields:

  • host : hostname

  • port : port of the service

  • associated-environement : is the "host" and "port" associated environment variables that allows to replace the default one. This field is not mandatory.

  • "host" : associated "host" environment variable

  • "port" : associated "port" environment variable

  • ssl : ssl configuration IN PRODUCTION IT IS MANDATORY TO USE CERTIFICATE AND KEY THAT ARE *NOT* SELF SIGNED

  • cert : certificate file

  • key : key file

Configure Sentiment classifier runtime

Example of Configuration:

network configuration
{
    "runtime":{
        "request-max-size":100000000,
        "request-buffer-queue-size":100,
        "keep-alive":true,
        "keep-alive-timeout":5,
        "graceful-shutown-timeout":15.0,
        "request-timeout":60,
        "response-timeout":60,
        "workers":1
    }    
}

The Runtime fields:

  • request-max-size : how big a request may be (bytes)

  • request-buffer-queue-size: request streaming buffer queue size

  • request-timeout : how long a request can take to arrive (sec)

  • response-timeout : how long a response can take to process (sec)

  • keep-alive: keep-alive

  • keep-alive-timeout: how long to hold a TCP connection open (sec)

  • graceful-shutdown_timeout : how long to wait to force close non-idle connection (sec)

  • workers : number of workers for the service on a node

  • associated-environement : if one of previous field is on the associated environment variables that allows to replace the default one. This field is not mandatory.

  • request-max-size : overwrite with environement variable

  • request-buffer-queue-size: overwrite with environement variable
  • request-timeout : overwrite with environement variable
  • response-timeout : overwrite with environement variable
  • keep-alive: overwrite with environement variable
  • keep-alive-timeout: overwrite with environement variable
  • graceful-shutdown_timeout : overwrite with environement variable
  • workers : overwrite with environement variable

Sentiment Analyzer service

To run the command type simply from tkeir directory:

python3 thot/sentiment_svc.py --config=<path to configuration file>

or if you install tkeir wheel:

tkeir-sentiment-svc --config=<path to configuration file>

A light client can be run through the command

python3 thot/sentiment_client.py --config=<path to configuration file> --input=<input directory> --output=<output directory>

or if you install tkeir wheel:

tkeir-sentiment-client --config=<path to configuration file> --input=<input directory> --output=<output directory>

Sentiment Analyzer Tests

The converter service come with unit and functional testing.

Sentiment Analyzer Unit tests

Unittest allows to test Sentiment Analyzer classes only.

python3 -m unittest thot/tests/unittests/TestSentimentConfiguration.py
python3 -m unittest thot/tests/unittests/TestSentiment.py

Sentiment Analyzer Functional tests

python3 -m unittest thot/tests/functional_tests/TestSentimentSvc.py