WOW, guys! The transcription feature in the new Notes App is no less than awesome!
While having a first test I was wondering if technically the output language for the markers could be chosen or switched?
I transcribed a German dialogue and the markers are perfectly translated into English. So the LLM understands German perfectly and the translation is actually one step too far for my case. The feature would be an absolute game changer in our workflow, if the marker texts could be in German (or even other languages).
Is this something that might be a possible update in a later version, or is it technically not an option?
But many thanks for this great stuff, anyway!
Kitch Membery @Kitch2024-07-09 23:15:26.047ZSo glad you like the new Transcribe feature in the Notes app.
Let me log this request internally, so if can be considered for a future update to the package.
Thanks for the great suggestion :-)
- SIn reply toMatthias_Pasedag⬆:SoundFlow Bot @soundflowbot
This report was now added to the internal issue tracked by SoundFlow as SF-1347
In reply toMatthias_Pasedag⬆:Christian Scheuer @chrscheuer2024-07-09 23:20:56.451ZHi Matthias,
Yes, there'll be options to select the proper model, language and whether or not auto-translation to English should be on or off. Coming out very soon!
- Ddanielkassulke @danielkassulke
As above - this is a remarkable tool. On a related note - could we have Clipboard as an additional target? I.e. the transcription is stored as text in the clipboard? There are a few instances (a couple of which I've already encountered) where concatenating the entire output of the transcription added a few unnecessary steps. It'd be cool to have this option!
Christian Scheuer @chrscheuer2024-07-10 22:01:58.446ZGood idea - tracking as SF-1357
- In reply todanielkassulke⬆:
Chris Shaw @Chris_Shaw2024-07-10 23:58:13.532Z2025-03-06 18:23:24.454ZYou could run this script after transcribing to copy the text into the clipboard.
Just select the track with the markers you'd like in the clipboard first.
Each marker will be it's own line of text.(You can delete line 10 if you don't want to log the marker text)
let markerTrack = sf.ui.proTools.selectedTrack.normalizedTrackName let allTrackMarkers = sf.app.proTools.memoryLocations.invalidate().allItems.filter(i => i.trackName == markerTrack) let markerText = "" allTrackMarkers.forEach(m => { markerText = markerText + `${m.name}\n` }) log(markerText) sf.clipboard.setText({text:markerText}) sf.clipboard.waitForText({}) sf.interaction.notify({message:"Marker text now in clipboard"})- Chris Shaw @Chris_Shaw2025-03-06 18:24:15.283Z
Oops!
Forgot to invalidate the markers.
Code above has been updated
//CS//
- In reply tochrscheuer⬆:MMin Kyu Kang @Min_Kyu_Kang
Is it possible to use that feature at the moment?
It's a really crazy feature, and I think it would be even better if I chose the language.
- Christian Scheuer @chrscheuer2024-08-01 15:22:07.304Z
Hi Min,
We got a bit delayed on getting this out, but it should come out soon!
Matthias Pasedag @Matthias_PasedagThank you guys for getting this out so fast - this is dope! :D
- Christian Scheuer @chrscheuer2024-09-11 18:16:36.120Z
Thank you, Matthias! I can see I forgot to update this sub-thread, but yes, this feature was launched some time ago :)
- MMin Kyu Kang @Min_Kyu_Kang
Hi!
But the translation function doesn't seem to work.
i played Japanese voice, turned on the translation, and changed the target language to Korean(or eng), and wrote it down in Japanese no matter how much they tried.
- Matthias Pasedag @Matthias_Pasedag
Hi!
I just figured that the translation doesn't work on my system as well.
What works is the automatic recognition of the language and writing the markers in that language, which is perfect.
On my initial post the markers were translated to English on other languages.
But it sees not to change with the translation feature, it's writing in the source language.- Christian Scheuer @chrscheuer2024-09-12 09:33:12.326Z
But it sees not to change with the translation feature, it's writing in the source language.
Ah ok, I'm starting to understand what might be wrong. Let me see if I can work on this.
- Christian Scheuer @chrscheuer2024-09-12 11:11:10.063Z
Please try this preview to see if it fixes it:
- MMin Kyu Kang @Min_Kyu_Kang
Hi. now works as intended.
If i use the translation function, i get a marker in English, and if i don't use the translation function, it's written in the original language. cool.
It would be better if there is a function that translates other countries' languages into designated languages as an option in the future. (Expandment of translation function, not just english)
- Christian Scheuer @chrscheuer2024-09-12 13:01:41.782Z
Absolutely! We'll see how the underlying models evolve. Proper translation will likely require using an LLM.
SoundFlow 5.8 ships with a local LLM based on Llama 3. It's pretty slow, but it runs completely locally, so nothing is sent to the cloud.You could look into doing this yourself today with a script:
function translate(text, targetLanguage) { var translation = sf.ai.createCompletion({ model: 'llama3', prompt: ` Please translate the following text into ${targetLanguage}. Respond just with the translated text, no preamble or anything else. The text: ${text} `, }).response; return translation; } var text = `Hello there, how are you doing?`; var translatedText = translate(text, 'Spanish'); log(translatedText);
- In reply toMin_Kyu_Kang⬆:Christian Scheuer @chrscheuer2024-09-12 09:29:52.828Z
Hi Min Kyu Kang,
The "Translation" feature is a model-controlled translation that if turned on should translate any language to English. So, if Translation is on, no matter which language is spoken, it'll output in English.
I don't necessarily recommend setting this to On, as in most cases you'd likely prefer the original language. I can also imagine that the model data for translation is less accurate.
- SIn reply toMatthias_Pasedag⬆:SoundFlow Bot @soundflowbot
The linked internal issue SF-1347 has been marked as Done
- SIn reply toMatthias_Pasedag⬆:SoundFlow Bot @soundflowbot
The linked internal issue SF-1347 has been marked as Done
- SIn reply toMatthias_Pasedag⬆:SoundFlow Bot @soundflowbot
The linked internal issue SF-1347 has been marked as Done
- SIn reply toMatthias_Pasedag⬆:SoundFlow Bot @soundflowbot
The linked internal issue SF-1347 has been marked as Done