I'm Sudhanshu Salunke
an Exporter & Importer. a Chemical Manufacturer. a B2B Wholesale Supplier. a FMCG Distributor.

5 Ways To Make Money Using OpenAI Whisper (+Bonus Trick)

OpenAI whisper is a State-Of-The-Art (SOTA) speech recognition technology developed by OpenAI. It is free and open source, unlike other SOTAs such as Azure, Google, or Meta, which cost money.

Furthermore, OpenAI is far more accurate and straightforward to use.

Many of us are still unaware of how capable AIs can be in creating things that normal humans cannot even imagine.

Without the proper knowledge, we blame AI for taking over human jobs and work, but as humanity evolves, so will technology. It’s inevitable.

As a result, we must treat AI as a friend rather than a competitor to accomplish our goals.

OpenAI also has other services like Dall-E 2 and ChatGPT. However, people continue to use it for entertainment rather than for income.

We will go over various ways to use OpenAI whisper for both personal and professional purposes.

What is OpenAI Whisper?

According to OpenAI, Whisper is a web-based Automatic Speech Recognition (ASR) system trained on 680,000 hours of multilingual and multitask supervised data.

Whisper demonstrates that using a large and diverse dataset improves robustness to accents, background noise, and technical language.

It also supports transcription in multiple languages and translation from those languages into English.

Whisper is releasing models and inference code as a foundation for developing useful applications and furthering research into robust speech processing.

is OpenAI Whisper accurate?

Compared to other State-Of-The-Art Technologies such as Kaldi, Vosk, wav2vec 2.0, and others, OpenAI whisper had a comparatively Low WER (Word-Error-Count).

Whisper is exceptional, given that it is free and open source. Let’s look at the comparison between different ASR systems.

In long-form transcription, Whisper competes with cutting-edge commercial and open-source ASR systems.

The distribution of word error rates from six ASR systems on seven long-form datasets with input lengths ranging from a few minutes to a few hours is compared.

The boxes represent the quartiles of per-example WERs, with the aggregate WERs for each dataset annotated on each box.

On all datasets, the Whisper model outperforms the best open-source model (NVIDIA STT) and, in most cases, commercial ASR systems.

The catch is that while these results are impressive, there is a different story when it comes to non-English languages.

The graph below depicts the word error rate for each supported language. The lowest Word Error Rate is 3% in Spanish, and the highest is 47% in Nepali.

Below we see the distribution of languages as a function of the Word Error Rate. Of all the 82 languages, 50 of them have Word-Error-Rates greater than 20%.

There are five model sizes available, four of which are English-only, with speed and accuracy tradeoffs. The names of the available models, as well as their approximate memory requirements and relative speed, are listed below.

So, to answer our main question, how can we make money with OpenAI Whisper?

1. Start a Transcription or Translation Service

There are numerous Transcription and Translation Services available, such as gotranscript, transcribeme, rev, and happyscribe.

You can start your own business offering a Top Notch Service for a lot less cost and with much more precision than other services.

This service could be provided to individuals or businesses who require audio or video transcription or translation.

Many podcasters nowadays talk for more than an hour, sometimes even three hours, and as you know, many transcription services charge per minute. As a result, you can offer your services at extremely competitive rates.

Creating a transcription service for medical professionals, such as transcribing patient notes or converting audio recordings of medical procedures into written form, is a good place to start.

Create a transcription service that is specifically tailored to educators’ needs, such as transcribing lectures or converting educational videos into written form.

Transcription services tailored specifically to the needs of legal professionals, such as transcribing court proceedings or converting legal documents to audio format.

All these services could be provided for free or as part of a subscription with in-app purchases.

You can focus on a single niche or offer services to multiple niches in a single package.

2. Create a voice-to-text App

This concept entails creating a mobile app that allows users to take voice notes, which are then transcribed into written text.

You could create a tool that allows users to create and manage tasks by speaking, which is then transcribed into written text.

You could create a mobile app that enables users to convert spoken language into written text.

You could create a mobile app that allows users to send and receive text messages by using their voice, which is then transcribed into written text.

3. Become a Freelancer on Fiverr

You can begin your gig on a website such as Fiverr. As a new member, you must begin offering services at the lowest possible price.

You can get a head start by asking a friend or family member to purchase your services. Treat your family member or friend as if they were a real client, and speak and act professionally.

Right now, Fiverr is overcrowded. To achieve the best results, you must continue to post more and more gigs on a daily basis.

When you look at the top Fiverr freelancers, you’ll notice that the majority of them have more than 50 gigs. So, the more gigs you have, the more likely it is that you will be found.

You can have gigs for YouTubers, Musicians, and Podcasters. You can offer them translation, transcription, or even subtitles of their content. Assist musicians with lyrics. It is freelancing rather than starting a business.

4. Build a Language Learning App

This can be a hit-or-miss idea. Whisper could be used to create a language learning tool that listens to a user’s spoken or written language and gives feedback based on their input.

You can create your own language exchange app that pairs native speakers of two different languages who want to learn the mother tongue of their learning partner.

You can begin by providing limited translations and feedback, followed by more detailed information in the paid plan. You can offer translation and writing exercises based on user interaction.

Individuals who want to learn a new language could be offered this tool as a subscription service.

5. Start your own Free Transcription and Language Detection Website

You can create your own free website that will transcribe recorded audio and convert it to text format. You can also include a language detection feature on that website. Just as huggingface did here.

Is OpenAI Whisper safe to use?

According to their GitHub Repo, it states.

So this is Completely Safe and Free to use.

Problems with OpenAI Whisper

After testing Whisper in multiple projects and languages, there are a few issues that you will undoubtedly encounter in your workflow.

I discovered that Whisper sometimes struggles to understand what is being said.

For example, if you speak in a low-pitched voice and there is background noise behind the dialogue. OpenAI simply ignores the sentence, issuing no errors or warnings.

In some cases, if a video contains multiple languages, Whisper may skip the entire language and only process a single language within the video.

Bonus Trick

As previously discussed, Whisper has some problems. We can reduce it by nearly 90% by doing just one thing.

Use the free Adobe Enhance feature to improve the audio by removing background noise and increasing the file’s lower-pitch audio.

Adobe Enhance currently only accepts 1GB file size and 1 hour of audio. So, if you have a three-hour audio file, you can split it into three separate files, then merge them into a single mp3 or Wav file and use whisper on it.

Conclusion

Whisper is the most accurate open source Automatic Speech Recognition (ASR) system out there. No matter how good AI is, we must keep one thing in mind. AI will never be able to achieve what humans can. Humans will always be superior in the long run.

Whisper will be a valuable tool for both researchers and hackers due to its accuracy and ease of use when compared to other open-source options.

Whisper’s performance is influenced by its compute intensity, so applications that require larger, more powerful versions of Whisper should run it on GPU, whether locally or in the cloud.

You can find more information about OpenAI Whisper here.

How to Study Korean the Right Way in 2024

According to Duolingo Language Report 2023, Korean is the world’s sixth most popular language to study, and it is the fastest-growing language in Brazil, France, Germany, India, and Mexico!

Many people still believe that learning Korean is difficult and that it is impossible to learn on your own. But guess what? If you start learning Korean the right way, you will soon realize that it’s one of the easiest languages in the world.

Korean is really easy to learn, in fact, Hangul is said to be the easiest alphabet in the world. Korean, unlike other East Asian languages, is not a tonal language. This means that the meaning of the word remains unchanged regardless of your accent. Even the basic rules of grammar are fairly simple, so you should be able to construct sentences as soon as you can read Hangul. Many people continue to be dumbfounded because they do not take the proper steps.

By following the steps described below, you will be able to achieve fluency in no time.

Get Your Inspirations Right

Before you begin anything, you must first understand your inspirations.

Discover what inspired and motivated you to begin learning Korean.

Was it because you listen to Kpop or enjoy watching Korean movies, or because you ate Korean food or experienced some Korean culture, or maybe you were inspired after watching the squid game?

Whatever it is, being inspired to learn something new that you did not know before is a good thing. Knowing what inspired you will put you on the right track.

You have to remember that your inspiration should not turn into an obsession. So what does that mean, I will explain it in the next point.

Know Your Reasons

This is where many of us make our first mistake. Even before you start. Ask yourself why do you want to learn Korean. And what are you going to do with it?

Inspiration is about others, Obsession is about yourself.

Is it because you want to work there, study there, start a business, or do you even enjoy Korean drama or music? Whatever the reason, remember that obsession and inspiration are not the same things.

Inspiration is your motivation to do, be, or create something. Others may or may not be aware of your motivation. Obsession is something that consumes you; like a drug, it is always on your mind and takes priority over everything else.

For example, if you’re inspired by someone else’s story or you want to be like them, especially if they’ve been through something similar, you will smile as you look at their successes and failures, and you will refuse to give up and work hard.

However, if you’re obsessed, you’ll do anything to look like them. Did they get a new tattoo? You, too, will. Do you like Korean Idols? You’ll start idolizing them and eventually become a stalker.

The main difference is one of attitude, as well as expectations and behavioral standards. The difference between a learning approach that encourages experimentation and learning from mistakes and one that punishes every single mistake.

It occurs when we are unable to strike a balance between what is right and what we should do, rather than simply doing everything and endangering ourselves and others to complete it.

Don’t get me wrong, you can draw inspiration from anything, including Korean dramas and Kpop idols, but becoming obsessed will do more harm than good. Ask yourself, whether watching Korean dramas or following Kpop idols will benefit you in your future endeavors.

This way, you’ll be able to discover your true motivations and how steadfast you are in your decisions.

Obsessing over something useful is better than obsessing over something useless.

Learn Hangul

As with any new language, learning the alphabet is a great way to get started on the road to fluency. You’re probably wondering how to learn the Korean alphabet. While the unfamiliar Hangeul characters may appear intimidating at first, learning the Korean alphabet is not difficult.

Hangeul (한글) is composed of 24 letters, 14 consonants, and 10 vowels. The written consonants are shaped after the shape of the mouth when making each sound. Vertical and horizontal lines combine to form vowels.

It’s not an exaggeration to say you could learn Hangeul in the next hour or two. This contributes significantly to the popular goal of learning Korean in 30 days.

Hangeul is a phonetic language, which means that it will always sound exactly as it is written. More than 60% of English words contain silent letters (for example, knee, wrist, daughter, island, and so on).

Hangul is much more straightforward to learn. And if you want to learn Hangeul systematically, I recommend these two YouTube videos.

No need to learn Hanja

You may have heard a lot of people say that learning hanja is crucial if you want to speak Korean. Is it, however, important? It all depends on what you intend to do. Allow me to explain.

Hanja isn’t required, but it can be beneficial. Many Koreans claim they don’t know any/many Hanja; they may have learned them in school, but they’ve forgotten the majority of them since.

Certain generations were not required to learn them, and North Koreans are not required to learn them at all. So it is possible to get by without knowing any Hanja.

Don’t bother getting into it when you’re first starting.

However, learning Hanja can be useful. Only start learning hanja if you are at an advanced level.

1. When you want to read Korean Dictionary. If you know Hanja, you will be able to choose the correct definition much more quickly. This isn’t a big deal for beginners, but it can help advanced learners, especially if you start using a Korean-Korean dictionary. In Korean, there are a plethora of homonyms, particularly with 한자어.
2. Certain academic fields continue to use a lot of 한자 in their technical documents – textbooks, academic papers, and linguistics books. Unless and until you want to be a linguist in Korean, Hanja is unnecessary.

Find your Style

Everyone has a different style of learning. Finding your style determines what works best for you.

Perhaps visual memory is your strongest suit. Listening may help you absorb and comprehend information better. Some people can memorize certain things through muscle movement in some cases. You’ll never know what works best for you unless you give it a shot.

Maybe nothing I said in this guide will work for you. The most important thing to remember is that you are better, faster, and more efficient today than you were yesterday.

To learn Korean properly, you can implement one of these three methods. Let us examine the pros and cons of each strategy.

1. Grammar-Vocabulary-Practice (GVP Method)

This Method is, in my opinion, by far the most efficient. Many people may believe otherwise, but trust me when I say that if you follow it correctly, you will start picking up the language much clearer.

First, you will focus on grammar while putting vocabulary aside for a while. Some may argue that learning vocabulary will help you speak more clearly.

However, this is not the case. Of course, the more vocabulary you know, the better you will be able to express yourself, but if you don’t know how to put them in the sentence and where to put them with what, knowing vocabulary is useless.

Here’s what you can do: when you start learning grammar, you can pick up the grammar along the way, and as you practice with native Koreans, you can gradually add some vocabulary to your sentence structure.

This will not only help you understand the grammar correctly but will also gradually increase your sense of vocabulary as to where to add it to convey your message properly.

So, what about speaking, you may be wondering? Well, as you practice your writing with Koreans, you will be able to speak what you are writing, so your speaking, writing, and listening skills will improve as you practice with the correct grammatical structure.

Some people may become bored with doing grammar all the time, but keep in mind that without grammar, no language can be learned. You will spend less time reading if you use this method, so you must be careful about how much reading you do. So work on your grammar and vocabulary while you’re at it.

2. Vocabulary-Grammar-Practice (VGP Method)

Unless you have a lot of time and want to speak quickly with Koreans without worrying about grammatical structure, this strategy may be useful for you.

Here’s what you can do: spend time memorizing as much vocabulary as you can, and then start learning grammar while adding the vocabulary in the grammar rule that you’re currently learning. As you learn to construct your sentences, it will be very simple to add vocabulary to the sentence using this method.

Keep in mind, however, that learning grammar takes time, whereas memorizing vocabulary is easy. When you first begin learning Korean, it can be exciting and fun because you will be able to learn new exciting Korean words every day.

Initially, you may not receive positive feedback from native speakers because you will make so many mistakes that the Koreans will sometimes let you off the hook. Trust me, I have been there. They are Koreans, and they do not want you to feel bad if you make a mistake.

After all, they know you are a foreigner. The fewer errors you make while speaking, the more frequently you will be corrected. Needless to say that if you use this method, you must get good feedback and corrections from native speakers. You have to be straightforward with them.

3. Pronunciation-Reading-Vocabulary-Grammar-Practice (PRVGP Method)

Although it is probably not the most popular, it is a little more complicated and slower than the other two methods.

The idea is to first learn correct pronunciation and then develop a decent Korean accent. You learn hangul and how to read in Korean both during and after that process.

Once you can read and pronounce words in Korean, you can begin learning a massive amount of vocabulary (typically a list of the 500+ most common nouns, verbs, and adjectives). To commit these words to memory, you typically use a spaced repetition flashcard platform.

Because you learned how to pronounce and read Korean, you don’t use any English on your flashcards. You simply use images, the written Korean word, and possibly a Forvo sound file of a native pronouncing the word.

Then you open a Korean textbook or course and begin learning basic grammar. When you come across a new rule, you practice combining the 500+ words you learned previously to start constructing simple sentences.

This practice is obtained by writing or speaking with native speakers and receiving feedback.

You keep working your way through Korean grammar, memorizing new words as you come across them.

Don’t Watch Kdrama. Unless..

Almost everyone will tell you that watching Korean dramas or listening to Korean music will help you learn the language. It does, but only after a certain point.

When you first start, you have no idea what to study, how to study, or where to study. Even as a beginner, you may lack knowledge of grammar and vocabulary, and you may begin watching Kdrama believing that you will understand what they are saying, but in many cases, you will not.

Of course, you’ll pick up some new vocabulary, but you won’t know where or how to use it. Most of the time, you won’t understand a lot of what they’re saying, and instead of using drama as an excuse to study, you’ll end up watching it because you don’t understand what they’re trying to say, and you’ll start procrastinating.

So does that mean you should never watch Korean drama or listen to Kpop? No, it does not. I wouldn’t recommend watching Kdrama unless you’re at an intermediate level.

Because by the time you reach intermediate, you will have acquired a large amount of Korean vocabulary and will be able to construct a large number of good sentences without the assistance of others.

And if you know that particles in Korean take a lot of time and effort to understand clearly, by the time you get to intermediate, you’ll be able to tell which particles come from where.

Study Regularly. REGULARLY

Study for an hour today rather than two hours tomorrow. Many people do not study for one day and then double their time and effort the next.

That, however, is not how it works.

If you maintain your momentum and improve every day, you will not only reduce the time it takes to become confident but will also fuel motivation.

Be Grateful, Slow down and Enjoy life

It’s not only the scenery you miss by going too fast – you also miss the sense of where you are going and why.

Don’t just be a NERD. Expand your network, eat well, take care of your health, be yourself, stay positive, help others, spread love, and spend time with those who care about you.

Be grateful for what you have right now. Rather than focusing too much on the future. Make the most of what you have right now. If you make today better than yesterday, you will be rewarded. You are already halfway to the future.

Whatever you see, Label it

Whether you are studying indoors or outdoors, prepare your sticky notes and take a look around you. Write down any household items you see in Korean and stick them to that specific item.

For example, write down 물병 (water bottle) on a piece of sticky note and stick it to your bottle; then, whenever you go to refill it, try to guess the word for that bottle or a specific item.

You will learn a lot of words this way without even having to study. Clever Right.

Study with Native Koreans

Many learners already follow this, but some of these learners might study with their like-minded group. There’s nothing wrong with that but it’s more harm than good.

Learning with other learners can help you review what you’ve learned. However, if you want proper feedback and extra knowledge on how to make specific sentences, studying with or even getting help from Koreans will help you study more accurately, and not only will you achieve more than your learner friends, but you will also sound more like a native rather than a textbook person.

For example, when Koreans compliment you for learning Korean they will say 한국말 잘하시네요. (Your Korean is good) but many Korean learners will tend to say 아. 아니요. 잘 못해요 (Oh No, I am not good). Which is not wrong per se. It’s a more textbook answer.

If you want to sound more natural and like a native, say instead, say 뭐 이 정도 가지고 (I mean, it’s not that good). This is only one example. Many students will be unaware of this unless they speak with native Koreans. But guess what, you already knew that because, duh, you talk to Koreans.

Don’t memorize. Write it down

Instead of memorizing the words or sentences, write them down.

If you study Korean every day, you may complain about forgetting a lot of Korean vocabulary daily. The best way to overcome this is to write down whatever you learn every day.

This helps you remember specific words and reduces the number of spelling errors you make in the future.

Instead of taking notes on your computer or phone, write them down with your hands. Although several studies have suggested that taking notes digitally is a faster and more efficient process, it is not the best way to improve students’ memorization and word recognition.

Reading and writing on paper improves conceptual understanding, which is one of the benefits of handwritten notes.

Now you don’t have to write it all neatly with 100s of pens simultaneously, but rather write down the spelling and grammar correctly so that the next time you try to revise it, your handwriting won’t overwhelm you. It happens to a lot of people.

Stop Comparing Korean with your Native Language

Every language has its grammar, vocabulary, and characteristics. Rather than looking for parallels between your mother tongue and the one you’re learning, pretend you’re a baby. This is what I mean.

As we all know, babies learn languages by listening to different language complexes and tones every day. That is exactly what you must do. Each language has its structure, and comparing or attempting to remember them in your native language will only confuse you further.

Assume you are in the Stone Age and learning a language for the first time in your life. Learn as if it’s your mother tongue, without considering your mother tongue.

Stop using language apps.

When it comes to learning languages, everyone has different goals. Because learners frequently have specific goals in mind when learning a new language, what constitutes success for one learner may differ significantly from the finish line for another.

According to a study done by Shawn Loewen, professor of Linguistics and Germanic, Slavic, Asian, and African Languages at Michigan State University. More than 75% of participants rate it as good or very good.

Users were also very satisfied with the learning experience – more than 92% said the app met or exceeded their expectations, and 86% rated it as very good or good.

The majority of people are satisfied with whatever the apps teach them. After all, they are programmed and designed so that people will continue to use them for a long time because they are fun and easy. That is the main point: anything fun, easy, and quick is not the best way.

At least when it comes to language learning. If you want to learn something, you must devote time and effort to it.

Apps may have begun as a platform for language learning. But they are now just a translation-flashcard hybrid, relying on the same flawed practices it set out to avoid.

Consider this: how often do you hear the phrase, “He eats carrots for breakfast, lunch, and dinner?” Not very often. But you’ll have to see it again and again until you remember it. Because…Apps.

Some apps, such as Duolingo and Busuu, may have incorrect translations because they rely on various translation services. And any translation means that it will be inaccurate; look at Google Translate.

Even if you want to progress from beginner to intermediate, you won’t be able to do so. And becoming an intermediate learner necessitates a significant amount of grammar study.

Most apps fall short of explaining grammar in this area. Most of the time, they repeat the same thing without really teaching the best way to talk like a native speaker.

Don’t get me wrong. Apps aren’t always useless; they can help you get started by making the process a little more enjoyable at first, and they can also point you in the right direction when it comes to pronunciation. It can also be extremely beneficial if you use the VGP Method.

However, you must remember that at some point, you must begin learning grammar correctly, and apps are not the way to do so.

Practice Reading

You can read anything you want, including poems, comic books, novels, and articles. It’s entirely up to you.

But I recommend that you start with simple things like children’s poems and stories until you feel confident enough to move up the ladder.

Reading not only helps you learn new words but also improves your pronunciation. Once you know how to pronounce them correctly, you can start reading news articles, providing you with new information about the Republic of Korea.

Use a Korean dictionary.

If your Korean friends are busy dating and you need to know the meaning of certain words quickly, and with more information, a Korean dictionary will come in handy. Here are two excellent Korean dictionaries to help you learn the language.

Naver Dictionary (네이버 사전 | neibeo sajeon)

This dictionary is a great go-to app and website when you need accurate Korean and English translations. In addition to English, the dictionary website offers a variety of other language options, ranging from Japanese to Finnish.

The dictionary provides you with example sentences, the specific word translation (in noun, adjective, and other forms), and any additional meanings it may have.

The Naver Korean English dictionary has some limitations and isn’t the most up-to-date option in terms of style. It is, however, extremely accurate and well-detailed. This dictionary is most useful when searching for a single word rather than a complete sentence.

Daum Dictionary (다음 어학사전 | daeum eohaksajeon)

Daum’s online Korean and Korean English dictionaries work similarly to the Naver dictionary. When you search for a term, it returns all its known definitions. When you search by entering a sentence, it separates the sentence into terms.

Aside from serving as an English-to-Korean dictionary and vice versa, the dictionary can be searched for other languages. On the other hand, Daum does not have as many languages as Naver. One advantage is that Daum’s layout is a little clearer than Naver’s, making it easier to understand what comes up in your search.

Use Papago instead of Google Translate

Papago (파파고 | Papago)

Naver’s Papago app is one of the best Korean translator apps available. This Korean translator provides precise Korean translations of Korean sentences into English and other languages.

That is, it is not a Korean-English dictionary. You can, however, use it to check the meaning of a complete sentence or to translate how something you want to say in Korean can be said.

Papago employs neural machine translation to learn from its errors and determine what type of translations you are likely to require. Because they support each other, Papago is an excellent Korean translation tool to use in conjunction with Naver Dictionary.

Papago will also provide you with additional words and idioms that you should remember for the future. In addition to the website, there is an Android and iPhone translation app.

Learn Korean with TalkToMeInKorean

There are numerous good companies and websites available, such as koreanclass101.com and howtostudykorean.com. Almost everything on the market has been used and tested by me. TalkToMeInKorean, on the other hand, does a lot of things differently. There’s a reason they surpassed 1 million learners in December of last year.

The method used by TTMIK to teach Korean is exactly how everyone should be taught. They will begin teaching you all of the grammar points right away, without making you learn vocabulary first, and will instead focus on making your sentences using the rules they teach you.

They offer well-designed online courses, audiobooks, e-books, sample dialogue videos, comprehension quizzes, downloadable lesson notes, podcasts, and even a large number of premium lessons if you subscribe to their service. They even guarantee fluency simply by using the materials they supply.

The information provided by TTMIK is by far the most up-to-date and accurate that I have come across. Many websites nowadays have so much outdated material that will undoubtedly help you, but no one will use it, and you may even sound awkward.

Nothing, not even TTMIK, is perfect, no matter what you use. Make use of the best app in the world or read the world’s best book. You will not grow unless you put in the effort.

Let’s say you know all the vocabulary and grammar, but if you can’t speak and can’t convey your message properly in Korean, it’s pointless.

Speak, Write, Read, Listen Daily.