Technology Focuses

  • Conversation as a Platform & Artificial Intelligence
  • Internet of Things (hardware in general)
  • ASP.NET Core
  • Open Source

I am actively engaged with with community, startups and enterprises projects on different scales.. When I get the time, passion projects are a fun way to upskill, explore/deepen knowledge and create content for blog/tutorial/talk content. Below are a few projects.


Terminology

Caap: Conversation as a Platform
NLP: Natural Language Processing
LUIS: Microsoft’s Language Understanding Intelligence Service (NLP)
AI: Artificial Intelligence
ML: Machine Learning
IoT: Internet of Things (Connected hardware and devices)


Coding & Hacking in progress - Look out for blog posts!

IoT Nerf Turret with Voice and Computer Vision | [GitHub]
[ IoT, Ardunio, Servos, RaspberryPi, Cognitive Services, AI, ML, NLP, Image Recognition]
Building a Nerf gun turret which has the ability to turn (swivel) using arduio and servo motors. A camera and microphone will provide two input mechanisms to control the device. Audio will be converted from speech to text using Microsoft Cognitive Services Bing APIs, and sent to LUIS for NLP. Based on the command, the device will use the camera and computer vision tools to determine the target, aim and fire!


Ideas and Interest Areas

Conected Smart Mirror
[ IoT, CaaP, NLP, Cognitive Services, AI ]
I’ve always wanted to create a smart mirror (one way mirror overlaying a LCD screen). The mirror will be powered by a RaspberryPi and house a personal assistant chatbot. You can have a conversation with the chatbot which will tell you news, weather, personal schedule, etc. The mirror will know who it is talking to by a camera powered by facial recognition to retain user state and history. We can possible make the chatbot proactive, displaying news alerts and messages.


Completed Projects

JabbR-Core | [GitHub]
[ ASP.NET Core, SignalR, Authentication, Entity Framework, Open Source, Cross Platform ]
Open source project porting JabbR, a chat application built with ASP.NET and SignalR, to the ASP.NET Core framework. Working with Microsoft’s ASP.NET Core engineering team.

IoT 2-Factor-Auth Door Lock (Facial + Voice Recognition) with ItsJamesIRL | [GitHub]
[ IoT, RaspberryPi3, Python, Microsoft Cognitive Services, AI ]
2FA physical locking system using Raspberry Pi3 with RP Camera V2.1 and microphone. photo and audio is sent to the Microsoft Cognitive Services APIs to do identity detection based on facial and voice recognition.

Fridge ChatBot | [GitHub] [Demo]
[ CaaP, MSFT Bot Framework, NLP:LUIS, Azure Web App ]
ChatBot that helps you make decisions on what to cook for your next meal. The bot takes ingredients that you have at home, or would like to cook with and offers recipes with ratings, links and pictures. Once you decide on a recipe, it can send you a grocery list so you know exactly what to buy! This bot can even retain the state of your grocery list.

Schedule Bot with NoWaySheCodes | [GitHub Tutorial]
[ CaaP, MSFT Bot Framework, NLP:LUIS, Azure Storage, Azure Web App ]
Chatbot that allows you to search, find and display results for sessions and activities at an event. Create a database of sessions and activities using azure table storage which the bot will query. The results are formatted and displayed through media rich cards for better viewing and UX.