jpmschweitzerandClaude Fable 5
ed0e8221f1
The device now runs the complete face contract on glass: seven states with glyph expressions (custom 140px face font), matrix rain as pooled label streams (22px DejaVu+Noto katakana font), rage kaomoji frames (64px), orbit arc + elapsed counter wait cues, blink/talk/thought animations, idle clock (SNTP, Europe/Amsterdam), and the power ladder (active/ambient 35%/dormant 5% with rain parked). Voice path: ES7210 mic capture task streams 16k PCM over esp_websocket_client to the gateway; reply PCM buffers to PSRAM and plays via the audio task; touch-to-talk (tap to speak, tap to send). Protocol mapping per docs: thinking->effort, audio->speaking, error event->rage (auto-composes after 2 loops), WS loss->error face. Bring-up fixes: 8MB factory partition (fonts overflowed 1.5M), bsp_display_lock(0) is try-lock in this adapter (use UINT32_MAX), gong synth yields to feed IDLE0, wifi scan diagnostics (found SSID case mismatch), esp_websocket_client pinned ~1.3 (1.4 needs IDF>5.5). Verified on hardware: boots, connects to Wi-Fi and holds an open WebSocket to the gateway. Sauron (iMac TTY endpoint + ops console) planned in architecture.md. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
61 lines
1.3 KiB
C
61 lines
1.3 KiB
C
/* DeskLock — living-room face and voice for the Tatlock butler.
|
|
*
|
|
* Boot: display + face -> audio (gong) -> Wi-Fi (C6/ESP-Hosted) -> gateway WS.
|
|
* Interaction (phase 2): touch-to-talk — tap to speak, tap again to finish.
|
|
*/
|
|
|
|
#include "esp_log.h"
|
|
#include "bsp/esp-bsp.h"
|
|
|
|
#include "desklock.h"
|
|
|
|
static const char *TAG = "desklock";
|
|
|
|
static bool s_talking;
|
|
|
|
void app_on_touch(void)
|
|
{
|
|
face_activity();
|
|
|
|
if (!gw_connected()) {
|
|
return;
|
|
}
|
|
if (!s_talking) {
|
|
if (audio_is_playing() || face_get() == FACE_EFFORT) {
|
|
return; /* barge-in is phase 4 */
|
|
}
|
|
s_talking = true;
|
|
gw_send_text("{\"type\":\"utterance_start\"}");
|
|
audio_capture_start();
|
|
face_set(FACE_LISTENING);
|
|
ESP_LOGI(TAG, "listening…");
|
|
} else {
|
|
s_talking = false;
|
|
audio_capture_stop();
|
|
gw_send_text("{\"type\":\"utterance_end\"}");
|
|
face_set(FACE_PENSIVE);
|
|
ESP_LOGI(TAG, "utterance sent");
|
|
}
|
|
}
|
|
|
|
void app_on_playback_done(void)
|
|
{
|
|
face_set(FACE_IDLE);
|
|
}
|
|
|
|
void app_main(void)
|
|
{
|
|
ESP_LOGI(TAG, "DeskLock starting");
|
|
|
|
bsp_display_start();
|
|
bsp_display_backlight_on();
|
|
face_init();
|
|
|
|
audio_init();
|
|
audio_play_gong();
|
|
|
|
net_start();
|
|
|
|
ESP_LOGI(TAG, "DeskLock up");
|
|
}
|