Augmented Reality Glasses

Background

When the COVID-19 pandemic hit, and my university classes moved online, I began working as an intern for an augmented reality glasses company called ThirdEye Gen in Princeton, NJ. ThirdEye designs, builds, and sells hardware and software for industrial use cases. I began working there over the summer of 2020 as a Software Engineering Intern. After 2 months of working there, I transitioned to a full time role and continued to take my classes online at night. As is the nature of fast paced companies, I filled a variety of roles and worked on a multitude of projects. Here is a sample of a few of them.

1.COVID-19 Thermal Camera Attachment

In response to the onset of the COVID-19 pandemic, we created an accessory for our AR glasses that allowed the wearer to look at an individual or group of people and detect if anyone had a fever, a key symptom of Covid-19. I researched, developed, built, and tested dozens of prototyped before arriving at an optimal solution for a mechanism that would allow the thermal camera to be easily attatched and detatched from the glasses with ease. From there I iteratively refined the mechanical design, using my 3D printer to print over 50 versions. Once the design was perfected, I began working with manufacturers to produce the mounting mechanisms in bulk. I also created user documentation, a supply chain of all the neccesary peripheral components, and an internal automated system for inventory management and reordering inventory.

2.Software Suite for Alzheimer's

I was tasked with exploring how Mixed Reality glasses could be used in the treatment and or care of patients suffering from neurological diseases such as Alzheimer's. I started by conducting in depth research into the topic, performing a literature review, evaluating current AR/VR applications in the space, and conducting interviews with subject matter experts. From there, I presented my findings to the management team and was tasked with prototyping a few possible software tools.

The first tool I created was a tool that allowed patients with memory impairment to look at people and/or objects and a textbox with any relevant information would hover over the person/object. This would allow a patient to easily access important information that they may forget. For example, they could look at a nurse or caregiver, and it would remind the patient their name, their role, and any other pertinent information. I used a variety of machine learning and computer vision tools such as Google ML kit, TensorFlow, OpenCV, and more.

3.Ergonomic Modifications (coming soon)

  • When I started working at the company, I frequently heard negative customer feedback complaining of issues about fit, comfort, and general ergonomic problems with our existing AR glasses.

  • I took the initiative to conduct a study internally and through customer interviews. Using the results of the study, I created CAD models and 3D printed prototypes of modifications that would address the customer feedback.

  • After presenting the results of the study and prototyped modifications to the management of the company, I got approval to continue the project and begin to work with the manufacturers to understand the impacts on cost and timeline of each of the possible modification options.

  • The possible modifications were presented to the CEO of the company along with the pros/cons and estimated cost of each option

  • Once the CEO made the decision, I worked with the manufacturers and suppliers, including the production facility in Taiwan, to make the designs mass manufacturable and ensure the supply chain could accommodate the changes

4.First Responder and EMS software suite (coming soon)