Gourav Shenoy

I am a core member and contributor to the Apache Airavata open-source project. Airavata is a middleware that supports science gateways by implementing common features such as scientific job submission and metadata management. My research and contributions include the following:
1. Enhancing the distributed task-execution framework in Airavata by leveraging existing technologies such as Apache Helix, RabbitMQ/Kafka, and other Big Data frameworks such as Apache Storm.
2. Solving the problem… Show more

I am a core member and contributor to the Apache Airavata open-source project. Airavata is a middleware that supports science gateways by implementing common features such as scientific job submission and metadata management. My research and contributions include the following:
1. Enhancing the distributed task-execution framework in Airavata by leveraging existing technologies such as Apache Helix, RabbitMQ/Kafka, and other Big Data frameworks such as Apache Storm.
2. Solving the problem of meta scheduling in Airavata using Apache Mesos, which is a distributed systems kernel.
3. Adding support for Cloud and Containerized resources in Airavata (in addition to HPC clusters), to enable execution of data and compute intensive jobs (MPI and Serial). Resources include multi-cloud environments such as EC2, OpenStack; container platforms such as Docker; and container orchestration engines such as Swarm, Kubernetes; or the state-of-art DataCenter operating systems such as DC/OS.
4. Building first class SDKs for users, scientists to interact with and use Airavata APIs implemented using Thrift. Show less

Modifying the Xinu Shell and implementing Shell Commands & System Calls in C. We boot the XINU image on Beaglebone Black device running the Cortex A8 ARM processor.

This project focuses on finding possible solutions to the issue of managing workloads in a distributed environment with a micro-services based architecture, with emphasis on how these would benefit Apache Airavata. Internal operations in most distributed systems, like Airavata, can be thought of as an orchestration of a number of tasks, in an ordered fashion. We have implemented a fault tolerant, and scalable framework which allows distributed system developers to abstract task executions as a… Show more

This project focuses on finding possible solutions to the issue of managing workloads in a distributed environment with a micro-services based architecture, with emphasis on how these would benefit Apache Airavata. Internal operations in most distributed systems, like Airavata, can be thought of as an orchestration of a number of tasks, in an ordered fashion. We have implemented a fault tolerant, and scalable framework which allows distributed system developers to abstract task executions as a directed acyclic graph (DAG), providing executable task scheduling and workflow management. The framework follows a micro-services architecture and we have taken care of DEVOPS by writing scripts to seamlessly deploy the entire framework, as containers, on any orchestration platforms such as DC/OS (powered by Apache Mesos). A user-interface allows developers to create, deploy and execute DAGs on any target resource such as cloud or HPC clusters. Show less

Recent years have seen a dramatic increase in the availability of data collected in the practice of healthcare. If analyzed properly, this data (known as real world evidence or RWE) has the potential to transform the healthcare and life sciences space. Analyzing Real World Evidence can benefit all major healthcare stakeholders.
RWE is a single-tenant, multi-user cloud service offering that allows research scientists to quickly and effectively analyze health-care data in the cloud.

My… Show more

Recent years have seen a dramatic increase in the availability of data collected in the practice of healthcare. If analyzed properly, this data (known as real world evidence or RWE) has the potential to transform the healthcare and life sciences space. Analyzing Real World Evidence can benefit all major healthcare stakeholders.
RWE is a single-tenant, multi-user cloud service offering that allows research scientists to quickly and effectively analyze health-care data in the cloud.

My contributions:
> Single-handedly built the Identity & Access Management for this cloud service offering (from scratch).
> Enabled SSO between various components/applications within the cloud offering.
> Developed REST APIs for performing User/Account management.
> Worked on the security related items - making sure all components communicate securely (SSL), generating & installing security certificates for this cloud offering.
> Integrating the RWE offering with Watson Health Cloud ID management system - consuming REST APIs & managing the LDAP directory server. Show less

This project is part of Spring'16 I590 Course (Science Gateway Architecture). Here we build a Science Gateway Software-as-a-Service from scratch with DevOPs, and following Open Source standards.
Science Gateways are distributed computing environments that enable scientists to conduct computational experiments on computing clouds and supercomputers

My work includes:
> Building middle-ware for computational science gateways.
> Develop remote job submission interfaces to… Show more

This project is part of Spring'16 I590 Course (Science Gateway Architecture). Here we build a Science Gateway Software-as-a-Service from scratch with DevOPs, and following Open Source standards.
Science Gateways are distributed computing environments that enable scientists to conduct computational experiments on computing clouds and supercomputers

My work includes:
> Building middle-ware for computational science gateways.
> Develop remote job submission interfaces to computational cyberinfrastructure like IU Big Red 2 /Karst/Comet Supercomputers.
> Develop a simple metadata management system.
> Develop and consume API services.
> Using DevOps for deploying robust cloud services. Show less

Increasingly AWS is seen as the obvious choice for systems disaster recovery, but what about using it for disaster management? Here, I work on building an emergency management system using AWS to create a containerized, disaster ready, command and control center, in a docker container ready to be triggered by emergency personnel if disaster takes the campus infrastructure down.

My work includes:
> Creating an automated infrastructure that provides a platform with the following (in… Show more

Increasingly AWS is seen as the obvious choice for systems disaster recovery, but what about using it for disaster management? Here, I work on building an emergency management system using AWS to create a containerized, disaster ready, command and control center, in a docker container ready to be triggered by emergency personnel if disaster takes the campus infrastructure down.

My work includes:
> Creating an automated infrastructure that provides a platform with the following (in case of a disaster):
- Secure authentication, Secure communication (IM), Secure email, Secure file sharing, BOX/Cloud storage integration, and so on.
- Platform would be active only when needed, dormant rest of the time.
> Use of AWS Lambda, Amazon Dynamodb, Amazon EC2, Amazon IAM for building the automated infrastructure.
> Use of lightweight Docker containers to run services. Show less

Develop abstraction layer for heterogeneous clouds including OpenStack, Amazon AWS, Windows Azure & Docker.

Goals include:
> Accessing hybrid clouds while managing thousands of virtual machines.
> Integration of platform launchers.
> Ability to easily install and use the code on Windows, OSX, Linux.
> Provide a user manual.

Project dealt with analyzing twitter feeds for sentiment analysis of popular cuisines across the world like Indian, Chinese, Mediterranean and Italian. A decently large data set of tweets was fed to a classifier API and the results were then processed and presented using Google Charts.

Technologies used:
- Tweepy python APIs for fetching twitter feeds.
- Hadoop HDFS for storing tweets data set.
- Python 2.7 APIs for hadoop and processing of data.
- Google Charts
-… Show more

Project dealt with analyzing twitter feeds for sentiment analysis of popular cuisines across the world like Indian, Chinese, Mediterranean and Italian. A decently large data set of tweets was fed to a classifier API and the results were then processed and presented using Google Charts.

Technologies used:
- Tweepy python APIs for fetching twitter feeds.
- Hadoop HDFS for storing tweets data set.
- Python 2.7 APIs for hadoop and processing of data.
- Google Charts
- Bootstrap.js Show less

The objective of the concept is to provide clients the ability to manage and integrate workloads and resources on a cloud with their existing processes, management and business systems. Initiative includes integration and management of IaaS and PaaS across on-premise and off-premise cloud environments.

My research work included:
> Collaborating, under the leadership of Dr. Vijay K Naik (IBM Watson Research Center), with research members from IBM Japan, France & Canada Labs.
>… Show more

The objective of the concept is to provide clients the ability to manage and integrate workloads and resources on a cloud with their existing processes, management and business systems. Initiative includes integration and management of IaaS and PaaS across on-premise and off-premise cloud environments.

My research work included:
> Collaborating, under the leadership of Dr. Vijay K Naik (IBM Watson Research Center), with research members from IBM Japan, France & Canada Labs.
> Developing a Hybrid Cloud Broker & Policy Engine that seamlessly operates across multiple technologies enabling integration of heterogeneous IaaS or PaaS cloud platforms and services using standard API sets.
> Development of Usage Metering and Cost Aggregation Component, to periodically track the status of the deployed VMs, while calculate billing costs based on the resource consumption.
> Development of the IBM Cloud Orchestrator product, helping with end-to-end service deployment across infrastructure and platform layers.
> Worked on development of the Public Cloud Gateway (PCG), which provides an OpenStack API compatibility layer for public clouds such as IBM Softlayer, Amazon EC2, Numergy Cloud and non-IBM supplied OpenStack.
> Setting up OpenStack Keystone-To-Keystone federation for integration of hybrid cloud services. Worked with Steve Martinelli (OpenStack Keystone Core Developer at IBM Canada Lab) for this setup. Show less

This project aims to move the Sterling Billing and Rating system of the GBS, and replace all of the existing GBS functions and either replace them with HighDeal Billing and Rating functions or provide new program extensions to perform the functions not currently covered by HighDeal (HD). HD will handle both charge agreement contracts as well as non-charge agreement contracts.

Responsibilities:
* Worked with IBM team members from India & USA to setup & configure the HighDeal server &… Show more

This project aims to move the Sterling Billing and Rating system of the GBS, and replace all of the existing GBS functions and either replace them with HighDeal Billing and Rating functions or provide new program extensions to perform the functions not currently covered by HighDeal (HD). HD will handle both charge agreement contracts as well as non-charge agreement contracts.

Responsibilities:
* Worked with IBM team members from India & USA to setup & configure the HighDeal server & DB.
* Mapping of GBS call detail records to HighDeal format using Linux & Python scripts.
* Development of rating and billing plans using the HighDeal engine. Show less

Travelpedia is a travel planning application developed as a proof of concept using the IBM BlueMix platform. A sophisticated application that assimilates all aspects of planning a vacation, Travelpedia is a one stop solution to all holiday planning needs.

My Responsibilities:
* Requirements analysis & design.
* End to End design and development of the application.
* Use of BlueMix platform for development, building and deployment of the application.
* Unit testing &… Show more

Travelpedia is a travel planning application developed as a proof of concept using the IBM BlueMix platform. A sophisticated application that assimilates all aspects of planning a vacation, Travelpedia is a one stop solution to all holiday planning needs.

My Responsibilities:
* Requirements analysis & design.
* End to End design and development of the application.
* Use of BlueMix platform for development, building and deployment of the application.
* Unit testing & Acceptance Testing.
Show less

IBM SmartCloud Enterprise is the first IBM strategic IaaS public cloud offering.
BSS (Business Support System) component included functionalities like Catalog Management, Contract Management, User Management, Business Partner Management, Prime Bidder, Report Management, Metering and Billing, Image Management, Software Bundles etc.

My Responsibilities:
1. REST API development using Apache WINK.
2. Back-end code development using Java/ J2EE.
3. Back-end database connectivity &… Show more

IBM SmartCloud Enterprise is the first IBM strategic IaaS public cloud offering.
BSS (Business Support System) component included functionalities like Catalog Management, Contract Management, User Management, Business Partner Management, Prime Bidder, Report Management, Metering and Billing, Image Management, Software Bundles etc.

My Responsibilities:
1. REST API development using Apache WINK.
2. Back-end code development using Java/ J2EE.
3. Back-end database connectivity & management using JPA framework.
4. Messaging service implementation using JMS.
5. Scrum team leader for one of the project epic.
6. Follow the agile methodology for project development. Show less

This project aimed at creating a page for our college website, that would stream the live events that took place at college.
Typically it would allow any person, at any part of the world to be in a position to watch LIVE all the events and activities that were organized at our college. The user has the flexibility to watch the LIVE video, either using the integrated video player in the webpage; or using an external video player of his/her own choice.

A national research project; which aimed at developing a self learning intelligent module - using A.I., which was capable of automatically tagging the words in a konkani corpus with the 'most appropriate' POS (part of speech) tag, depending upon the context in which it was used in the sentence.
The project also aimed at developing necessary tools and utilities, that would be helpfull for researchers to determine the performance of the POS tagger as compared to the baseline performance, and… Show more

A national research project; which aimed at developing a self learning intelligent module - using A.I., which was capable of automatically tagging the words in a konkani corpus with the 'most appropriate' POS (part of speech) tag, depending upon the context in which it was used in the sentence.
The project also aimed at developing necessary tools and utilities, that would be helpfull for researchers to determine the performance of the POS tagger as compared to the baseline performance, and to determine the percentage accuracy of the automatic tagger, along with other utilities. Show less