Summer Code Sprint2015 Progress Reports
- OWTF - Viyat Bhalodia
- OWTF - Arun Sori
- OWTF - Alexandra Sandulescu
- Hackademic - Anirudh Anand
- Hackademic - Minhaz AV
- Hackademic - Tapasweni Pathak
- AppSensor - Sumanth Damarla
- Seraphimdroid - Kartik Kohli
OWASP Summer Code Sprint 2015 Progress Reports
This page will track the progress reports of the different selected projects for the OWASP Summer Code Sprint 2015 projects.
Week 1 (2015.07.13 - 2015.07.17)
Operating System: Ubuntu 15.04 Desktop Processor: Intel Core i3 -3227U CPU @ 1.90GHz x 4 OS Type : 64-bit Disk: 17.5GB (Server or Desktop?) + (What hardware?)
Technologies researched on : Overview of Time Series Databases. Influxdb documentation. Learnt InfluxQL (Query language for Influxdb). Overview Elasticsearch and related tutorials. Overview Logstash and related tutorials. Overview Kibana and related tutorials.
Environement Setup: Installed ElasticSearch 1.4.4, Logstash and Kibana 4.0 and Nginx environment.(To set up a reverse proxy to allow external access) individually. What versions of each component? Working on linking all the three[how the logstash output be given to elasticsearch (the parameters to be mentioned) and how to generate metrics using Kibana from Elasticsearch inputs] but I need to configure it with private IP.(Linking all three what? ) Installed Appsensor environment.
Links I referenced (Teaching Resources):
InfluxDB Documentation: https://influxdb.com/docs/v0.9/introduction/overview.html
Logstash Documentation: https://www.elastic.co/guide/en/logstash/current/getting-started-with-logstash.html
Elastic Search Documentation: https://www.elastic.co/guide/en/elasticsearch/guide/current/getting-started.html
Visualizing Logs Using ElasticSearch, Logstash and Kibana : https://www.youtube.com/watch?v=Kqs7UcCJquM Logs & Metrics: Use the Force, Gain the Insight (Need to have pro access which I have xD ) https://teamtreehouse.com/library/logs-metrics-use-the-force-gain-the-insight
Step by step installation on ELK Stack on Ubuntu: https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-4-on-ubuntu-14-04
Week 2 (2015.07.20 - 2015.07.24)
Configured Simple Websocket Dashboard from Appsensor and deployed in Tomcat 7:
Steps to Install Tomcat7 in Ubuntu 15.04: https://www.digitalocean.com/community/tutorials/how-to-install-apache-tomcat-7-on-ubuntu-14-04-via-apt-get
Building AppSensor Environment: AppSensor is a multi-module maven project. The project requires Java version 7 or higher. Building is generally handled by the following steps
clone the repo (or your fork) git clone https://github.com/jtmelton/appsensor.git
get into appsensor directory cd appsensor
install multi-module parent - one time requirement per version mvn -N install or sudo apt-get update sudo apt-get install maven
run the tests - done every time you make changes mvn test
Deploying Sample App in Standalone Container: If you'd like to deploy one of these applications to a standalone application server or servlet container, follow these simple steps: Download the source code (either zip download or git clone) Go into the folder containing the application you want to deploy (e.g. 'simple-dashboard') Execute 'mvn package' Look in the 'target' folder that gets generated and find the '.war' file Deploy this WAR file into your application server / servlet container and start it up You should now be able to interact with the application locally
Deploying Sample App in IDE-managed Container: If you'd like to deploy one of these applications to a standalone application server or servlet container, follow these simple steps: Download the source code (either zip download or git clone) Import the application into your IDE (using 'import maven project' mechanism) Setup an IDE managed container if you don't have one already Add the application to your container Startup the container You should now be able to interact with the application locally
Providing syslog as input for Logstash: Syslog and its configuration options: https://www.elastic.co/guide/en/logstash/current/plugins-inputs-syslog.html
ELK STACK has been configured
Ports used for ELK Stack: Port 9200: Elasticsearch Port 5610: Kibana
Plugins Installed: Marvel: Used as GUI for Elasticsearch. Kopf: Used as GUI for Logstash.
Sample Logs used in ELK Stack: Manual logs are inserted from terminal.
Ingesting CSV data with Logstash and analysing in Kibana.
Current Tasks: Researching on syslog format. Working on importing syslog format logs into Logstash. Learning the filters supported for syslog in ELK stack technology.
Tasks ahead: Extracting logs (syslog format) from the applications configured with AppSensor.
Reference Links: Centralized logging with an ELK stack (Elasticsearch-Logstash-Kibana) on Ubuntu: https://deviantony.wordpress.com/2014/05/19/centralized-logging-with-an-elk-stack-elasticsearch-logback-kibana/ About Marvel Plugin: https://www.elastic.co/guide/en/marvel/current/index.html About Kopf Plugin: https://github.com/lmenezes/elasticsearch-kopf Ingesting CSV Data with Logstash: http://www.rittmanmead.com/2015/04/using-the-elk-stack-to-analyse-donors-choose-data/ Download free CSV datasheets: http://data.donorschoose.org/open-data/overview/
The student fixed bug regarding locking of application on Android 5+.
No activity. Student also said that he was home, so thats the reason of his slow progress, but that he will catch up from monday.