Transcribing Like a Boss, For No Cost

 

One question that I’ve been asked a few times in the past year is if I was aware of a good tool to transcribe text from a video or audio file. AWS has its transcribe API for this, but there is a monthly free limit before it starts charging. There is now a fantastic free option in the form of OpenAI’s Whisper.

With the increasing amount of audio and video content being generated and made available online, the ability to quickly and accurately transcribe this content is becoming increasingly important. OpenAI's Whisper audio-to-text capability offers a powerful solution to this problem.

Whisper is a deep learning-based model trained on large amounts of data to produce high-quality text transcriptions from audio. It has been specifically designed to transcribe speech in various settings, including noisy environments, and to handle multiple speakers and accents. The model has been trained on a wide range of data, including publicly available audio content, which means that it is well-suited for use in the field of OSINT.

Whisper is capable of processing large amounts of audio data quickly and accurately, and currently at least, for free. Another advantage of using Whisper for OSINT is its ability to handle multiple languages and accents. This makes it possible to transcribe audio content from various sources, regardless of the language spoken.

I installed Whisper on my Windows host system using the command:

pip install -U openai-whisper

You can view the code for the project here: https://github.com/openai/whisper

The tool also requires the audio & video processing tool ffmpeg to be installed on your system. https://ffmpeg.org/

Once installed, I tested it on a video from my personal trainer Ben Canning. By default, Whisper uses the first 30 seconds of audio to determine what language to use. Here it correctly detects English and starts transcribing the audio.









Once Whisper was finished processing the video, it generated multiple text files with the transcription. Some have just the text; others contain the text along with the timestamps, similar to the view produced in the terminal window.

Whisper handled the video with zero issues, so I decided to try one in a language other than English and with lower-quality audio. I picked one of the videos of Juan Joya Borja, AKA “Spanish Laughing Guy”.



 





Here, whisper incorrectly identifies the language as Galician, which is understandable considering its similarity to Spanish and Portuguese.








We can force Whisper to use a specific language with the “—language” option, as shown below.










As you can see here, Whisper is capable of handling a large number of languages.









As if all this wasn’t enough, Whisper can translate the video for you instead of transcribing.








For most uses, I would stick to having Whisper translate and then utilizing a dedicated translation engine like Google Translate or DeepL to translate, but I can see use cases where having the translation taken care of in “real-time” would be advantageous.

This capability has countless uses, including transcribing audio interviews or statements, transcribing and/or translating videos or audio content posted online, etc. To have this level of capability available for free is an extremely handy tool to have in the OSINT practitioner’s toolbox.

Comments

Post a Comment

Popular posts from this blog

SANS Index How To Guide with Pictures

Image
I got some great advice recently on creating an index for SANS exams and I wanted to write a blog post to share it with others. I took the SANS FOR 508 Computer Forensics course in 2008. It was way over my head but I had a great time and learned a ton. A few months ago I finally decided to go for my GCFA certification. I had four year old material from a course that had been completely revamped and no index. I passed the exam with a score in the 80s but it was a grueling experience. I had to rush on the last part of the exam and never felt comfortable. A few months after my GCFA exam I got an opportunity to attend a SANS SEC 504 class. I really wanted to prepare for my GCIH exam the right way so while I was at the conference I asked several individuals how they prepared their index. Most people told me that their indexes were 8-10 pages. A lot of these people had more SANS certs than I have friends so their methods obviously worked for them. My class had a teaching assistant (also SANS...
Read more

Leveling Up Your OSINT Game: Creating a Professional Email on a Budget

Image
  Some sites do not allow new users to register with a “free” email such as gmail.com or outlook.com. This is especially true if a site offers some free capability, but with the hope of converting you into a paying customer. Most OSINT practitioners would prefer to avoid using their “real” work email to signup for services, so the easiest solution is to register a domain (if you don’t already have one) and setup an email account using that. In this blog post we’ll explore how to accomplish this task as easily, and inexpensively as possible. Step 1: Acquire The Domain Many of us have likely purchased a .com or other domain over the years. Maybe you still have some, or maybe they expired. For years the only domain registrar I used was Google Domains. It was easy, inexpensive and provided free private registration to help enhance privacy. Recently, Google decided to get out of the domain registration business and is in the process of transferring all registered domains to Square...
Read more

Introducing FaviconLocator: The Eazy Button to Searching by Favicon

Image
  Favicons (short for favorite icons) are the cute little pixelated images that appear next to the site name in web browser tabs, bookmarks, etc. In the image below we can see the iconic GitHub logo on their site and the KFC logo on a bucket of chicken on their site. Originally, favicons were designed to add a touch of professionalism and branding, but for anyone who is like me and has over a dozen tabs open at any time, favicons are the only thing displayed and how I navigate tabs. Most of us rely on favicons on a daily basis but many never think of them as a tool we can use in OSINT and CTI investigations. That’s what we’re doing to talk about here as well as introduce a new tool. In addition to branding and aiding in navigation between tabs, favicons can serve as unique identifiers for websites. These unique identifiers can help us: Trace the online presence of organizations and discover obscure digital assets Map the online infrastructure of potential threats Potentially de...
Read more