At Kno.e.sis, I'm working on building the scalable real time system for processing sensor data and informal text such as tweets to extract city related events. And I also working on integrating the various city related events from different resources with different formats for better city management. Technology Stack : Apache Spark, MongoDB, Java, Python, PHP, MySQL.
Provided project support for RTÉ News 360, a project to assist RTÉ journalists in sourcing, aggregating, filtering and contextualizing newsworthy content with particular focus on user generated content. Successfully processed around 66 million tweets. Worked on “Real Time” News Events Detection Pipeline to process tweets from twitter streaming API and identify, store news events in database. Technology Stack : Apache Spark, MongoDB, Python, Java.
Taught cloud computing concepts and guided students to successfully finish their project work in Hadoop along with Amazon Web Services (AWS) cloud environment. Technology Stack : Hadoop (MapReduce), Java, Amazon Web Services (AWS).
|Big Data Technologies||:||Hadoop (MapReduce), Pig(Hadoop), Storm, Spark.|
|Semantic Technologies||:||RDF, SPARQL, OWL, RDFa.|
|Databases||:||MongoDB, MySQL, MS SQL Server 2008.|
|Programming Languages||:||Java, R, C, C++, Python (incl. SciPy, scikit-learn, matplotlib, Pandas), C#, PL/SQL, Android, Scheme.|
|Operating Systems||:||Linux, Windows, Unix (Mac).|