AI translations failing after update.

[mikiadev]

After updating packages, AI translations no longer work. I have previously used this to translate thousands of strings.. we can see that the endpoint is returning a correct response but it's not accepted?

getting messages [{"id":["hello world"],"references":[{"file":"src/routes/test/+page.svelte","refs":[null]}]}]
translation ok:  {"es":["hola mundo"]}
translation: en..[es] [0]: 1 messages not translated. Retrying...
getting messages [{"id":["hello world"],"references":[{"file":"src/routes/test/+page.svelte","refs":[null]}]}]
translation ok:  {"es":["hola mundo"]}

    ai: {
      name: 'translation',
      batchSize: 12,
      parallel: 1,
      group: {},
      translate: async (messages, instruction) => {
        console.log('getting messages', messages) //, instruction)
        const response = await fetch('https://10.100.0.9/api/v1/chat/completions', { 
          method: 'POST',
          signal: AbortSignal.timeout(1800000),
          headers: {
            'Content-Type': 'application/json',
            Authorization: `Bearer sk-n3v3rg0nn4g1v3y0uup`
          },
          body: JSON.stringify({
            model: 'gemma-4-26B-A4B-it-Q8_0',
            messages: [
              { role: 'system', content: instruction },
              { role: 'user', content: messages }
            ],
            temperature: 0.1
            // max_tokens: 32768
          })
        })
        if (!response.ok) {
          throw new Error(`translation failed: ${response.status} ${response.statusText}`)
        }

        const data = await response.json()
        let translated = data.choices[0].message.content.trim()
        console.log('translation ok: ', translated)
        return translated
      }
    },

[K1DV5]

Hi @mikiadev, this is actually not because of the update.

translation ok: {"es":["hola mundo"]}

I think it's not following the instructions:

wuchale/packages/wuchale/src/ai/index.ts

Line 75 in 416a6f3

Respond with a JSON array matching the order of the input items. Each element is an object keyed by locale code, where each value is an array of translated strings (one per plural form, or a single-element array for non-plural items).

It should return an array with the object inside, but it's returning the object.

Also, I checked it with Gemini and it works.

[daviareias]

I just had this happening to me as well, it seems sometimes gemini doesnt follow the instructions and wuchale keeps retrying, because gemini doesnt return an array:

[wuchale] result: {"fr":["Cela se produit lorsque l’application n’est pas correctement configurée pour trouver le bouton de paiement. Assurez-vous que le texte de recherche de l’e
xtension d’application du thème est correctement configuré, ou contactez le support."]}

Doesn't seem to be related to the update, just gemini being gemini

[daviareias]

Yes, it's gemini fault, I've retried a translation 100 times and it always return an object, I've added this and it got right first try lol:

instruction += "\n\nCRITICAL: Always respond with a JSON array even if there is only one item. Never respond with a bare object.";

[K1DV5]

Maybe I should put that CRITICAL emphasis on that instruction, and maybe "make no mistakes!" too lol /s