server: save processed mtmd chunks as placeholder (#27278)

This commit is contained in:
Xuan-Son Nguyen
2026-08-17 21:29:50 +02:00
committed by GitHub
parent ed1c3a20f5
commit 533b18257b
5 changed files with 58 additions and 15 deletions
+4
View File
@@ -195,6 +195,10 @@ public:
// will create a copy of the chunk if it contains non-text data
void push_back(const mtmd_input_chunk * chunk);
// same as push_back, but media chunks are stored as placeholders (no image/audio data)
// only use this if the chunk will never be encoded again (e.g. it is already in the KV cache)
void push_back_placeholder(const mtmd_input_chunk * chunk);
// appends server tokens, updates the media map. copies media chunks.
void push_back(server_tokens & tokens);