User Testing
The project innovates a new way to achieve immersive 3D experience using web-based first-person perspective desktop simulation, yielding the spatially considered feedback of a VR experience at none of the cost, a fraction of time taken to develop, and allowing for integration with web interactions, and the participation of a more diverse user demographic.
The published article reporting the findings from the research method can be found at
medium.comMethods
10 semi-structured interviews completing tasks via 3D simulation
Participants
8 users (NJ and NYC residents); 2 partners/subject matter experts (bus operators, NJ transit administrators)
Results
- 12% increase in overall satisfaction (68% → 80%)
- 15% increase in net promoter score (72% → 87%)
- 82% agree: “The design helped me find the essential information for my trip faster than my current process”
- 72% agree: “The design will help manage crowding and space on the bus”
Next Steps
- Address color accessibility
- Decrease cognitive load of display

Screenshots from the remote user tests with NJ residents (source: Ryan Lee)

Working natural language-capable information kiosk app embedded into simulation as an iframe
A/B Test: Legibility
During the test, one task asked to rate the legibility of the exterior text format. 5 participants rated the legibility of option A, all caps (control), the other 5 rated the legibility of option B, sentence case.
Note: 10 participants is not a statistically significant amount of data to draw a confident conclusion from a traditional A/B test. However, the exercise was performed to find out if there were any initial trends in the perception of large text from a long distance away, an insight useful for other public signage.
Surprisingly, the control (all caps) was rated 6% more legible. Despite the results, based on modern design consensus, sentence case was utilized for long text in the final design.

A: All caps (current standard)

B: Sentence case

AB test results for 10 participants