Sentiment Analysis on Twitter to Improve Time Series Contextual Anomaly Detection for Detecting Stock Market Manipulation
- Koosha Golmohammadi
- Osmar R. Zaiane, University of Alberta (Database)
In this paper, We propose a formalized method to improve the performance of Contextual Anomaly Detection (CAD) for detecting stock market manipulation using Big Data techniques. The method aims to improve the CAD algorithm by capturing the expected behaviour of stocks through sentiment analysis of tweets about stocks. The extracted insights are aggregated per day for each stock and transformed to a time series. The time series is used to eliminate false positives from anomalies that are detected by CAD. We present a case study and explore developing sentiment analysis models to improve anomaly detection in the stock market. The experimental results confirm the proposed method is effective in improving CAD through removing irrelevant anomalies by correctly identifying 28% of false positives.
Citation
K. Golmohammadi, O. Zaiane. " Sentiment Analysis on Twitter to Improve Time Series Contextual Anomaly Detection for Detecting Stock Market Manipulation". International Conference on Big Data Analytics and Knowledge Discovery (DAWAK), Lyon, France, August 2017.| Keywords: | |
| Category: | In Conference |
| Web Links: | Webdocs |
BibTeX
@incollection{Golmohammadi+Zaiane:DAWAK17,
author = {Koosha Golmohammadi and Osmar R. Zaiane},
title = { Sentiment Analysis on Twitter to Improve Time Series Contextual
Anomaly Detection for Detecting Stock Market Manipulation},
booktitle = {International Conference on Big Data Analytics and Knowledge
Discovery (DAWAK)},
year = 2017,
}Last Updated: November 04, 2019Submitted by Sabina P
