Hackathon Showcase

Ambient is your "second brain"–always remembering, and ready to whisper the right next move

Vibe Marketing AI builds a tool to simultaneously craft product vibe and market it—ushering in Pre‑AGI B2B software.

4 members Watch Demo

YouTube Video

Project Description

Project: Ambient – Your Screen’s “Digital Memory Lens”

⸻

Project Overview

•	What it does: Captures live screenshots/OCR of your desktop, indexes them in a local context DB, and surfaces relevant history & actions on-demand.  
•	User flow: Hit a shortcut → Ambient displays recent context → Generate prompts, quick replies, calendar events via MCP.

⸻

Running Code

•	Demo-ready: Fully implemented Tauri desktop app (Windows/macOS/Linux).  
•	Core modules:  
•	Screenshot/OCR pipeline  
•	Context‐indexing engine  
•	Interactive UI overlay

⸻

Innovation & Creativity

•	Local Context Measure: “Ambient” acts like a RAM buffer for your workflow—no cloud leaks, instant context recall.  
•	Memory + Agent Fusion: Combines persistent context with on-the-fly agent reasoning (inspired by Screen Pipe).  
•	MCP Pipe Dream: Seamless bridge between your local context and the MCP agent network for actions & scheduling.

⸻

Real-World Impact

•	Productivity boost: Reduces manual copy-paste; auto-suggests next steps based on what you’re actually doing.  
•	Privacy-first: All data stays local; OCR and indexing on-device.  
•	Accessibility: Screen-wide context aids users with cognitive load or visual impairments.

⸻

Theme Alignment

Building Agents with Reasoning Models
• Reasoning: Uses OpenAI’s agent framework to interpret screen context and decide next actions.
• Agent SDK: White-label OpenAI Agent SDK enables configurable workflows (ask, reply, schedule).
• Autonomy: Agent adapts over time via context memory—true ambient intelligence.

⸻

Technical Stack & Tools

•	Desktop Framework: Tauri (Rust + webview)  
•	OCR: Tesseract.js  
•	Context DB: SQLite + vectored embeddings  
•	AI Agent: OpenAI Agent Framework SDK (“White”)  
•	Connector: MCP Pipe Dream for MCP integrations  
•	UI: React + Tailwind in Tauri overlay  
•	Calendar API: MCP calendar module