CLOSE
Original image

How Do Computers Understand Speech?

Original image

More and more, we can get computers to do things for us by talking to them. A computer can call your mother when you tell it to, find you a pizza place when you ask for one, or write out an email that you dictate. Sometimes the computer gets it wrong, but a lot of the time it gets it right, which is amazing when you think about what a computer has to do to turn human speech into written words: turn tiny changes in air pressure into language. Computer speech recognition is very complicated and has a long history of development, but here, condensed for you, are the 7 basic things a computer has to do to understand speech.

1. Turn the movement of air molecules into numbers.


Wikimedia Commons

Sound comes into your ear or a microphone as changes in air pressure, a continuous sound wave. The computer records a measurement of that wave at one point in time, stores it, and then measures it again. If it waits too long between measurements, it will miss important changes in the wave. To get a good approximation of a speech wave, it has to take a measurement at least 8000 times a second, but it works better if it takes one 44,100 times a second. This process is otherwise known as digitization at 8kHz or 44.1kHz.

2. Figure out which parts of the sound wave are speech.

When the computer takes measurements of air pressure changes, it doesn't know which ones are caused by speech, and which are caused by passing cars, rustling fabric, or the hum of hard drives. A variety of mathematical operations are performed on the digitized sound wave to filter out the stuff that doesn't look like what we expect from speech. We kind of know what to expect from speech, but not enough to make separating the noise out an easy task.

3. Pick out the parts of the sound wave that help tell speech sounds apart.


Wikimedia Commons

A sound wave from speech is actually a very complex mix of multiple waves coming at different frequencies. The particular frequencies—how they change, and how strongly those frequencies are coming through—matter a lot in telling the difference between, say, an "ah" sound and an "ee" sound. More mathematical operations transform the complex wave into a numerical representation of the important features.

4. Look at small chunks of the digitized sound one after the other and guess what speech sound each chunk shows.

There are about 40 speech sounds, or phonemes, in English. The computer has a general idea of what each of them should look like because it has been trained on a bunch of examples. But not only do the characteristics of these phonemes vary with different speaker accents, they change depending on the phonemes next to them—the 't' in "star" looks different than the 't' in "city." The computer must have a model of each phoneme in a bunch of different contexts for it to make a good guess.

5. Guess possible words that could be made up of those phonemes.

The computer has a big list of words that includes the different ways they can be pronounced. It makes guesses about what words are being spoken by splitting up the string of phonemes into strings of permissible words. If it sees the sequence "hang ten," it shouldn't split it into "hey, ngten!" because "ngten" won't find a good match in the dictionary.

6. Determine the most likely sequence of words based on how people actually talk.

There are no word breaks in the speech stream. The computer has to figure out where to put them by finding strings of phonemes that match valid words. There can be multiple guesses about what English words make up the speech stream, but not all of them will make good sequences of words. "What do cats like for breakfast?" could be just as good a guess as "water gaslight four brick vast?" if words are the only consideration. The computer applies models of how likely one word is to follow the next in order to determine which word string is the best guess. Some systems also take into account other information, like dependencies between words that are not next to each other. But the more information you want to use, the more processing power you need.

7. Take action

Once the computer has decided which guesses to go with, it can take action. In the case of dictation software, it will print the guess to the screen. In the case of a customer service phone line, it will try to match the guess to one of its pre-set menu items. In the case of Siri, it will make a call, look up something on the Internet, or try to come up with an answer to match the guess. As anyone who has used speech recognition software knows, mistakes happen. All the complicated statistics and mathematical transformations might not prevent "recognize speech" from coming out as "wreck a nice beach," but for a computer to pluck either one of those phrases out of the air is still pretty incredible.

Original image
iStock / Collage by Jen Pinkowski
arrow
The Elements
9 Diamond-Like Facts About Carbon
Original image
iStock / Collage by Jen Pinkowski

How well do you know the periodic table? Our series The Elements explores the fundamental building blocks of the observable universe—and their relevance to your life—one by one.
 
 
It can be glittering and hard. It can be soft and flaky. It can look like a soccer ball. Carbon is the backbone of every living thing—and yet it just might cause the end of life on Earth as we know it. How can a lump of coal and a shining diamond be composed of the same material? Here are eight things you probably didn't know about carbon.

1. IT'S THE "DUCT TAPE OF LIFE."

It's in every living thing, and in quite a few dead ones. "Water may be the solvent of the universe," writes Natalie Angier in her classic introduction to science, The Canon, "but carbon is the duct tape of life." Not only is carbon duct tape, it's one hell of a duct tape. It binds atoms to one another, forming humans, animals, plants and rocks. If we play around with it, we can coax it into plastics, paints, and all kinds of chemicals.

2. IT'S ONE OF THE MOST ABUNDANT ELEMENTS IN THE UNIVERSE.

It sits right at the top of the periodic table, wedged in between boron and nitrogen. Atomic number 6, chemical sign C. Six protons, six neutrons, six electrons. It is the fourth most abundant element in the universe after hydrogen, helium, and oxygen, and 15th in the Earth's crust. While its older cousins hydrogen and helium are believed to have been formed during the tumult of the Big Bang, carbon is thought to stem from a buildup of alpha particles in supernova explosions, a process called supernova nucleosynthesis.

3. IT'S NAMED AFTER COAL.

While humans have known carbon as coal and—after burning—soot for thousands of years, it was Antoine Lavoisier who, in 1772, showed that it was in fact a unique chemical entity. Lavoisier used an instrument that focused the Sun's rays using lenses which had a diameter of about four feet. He used the apparatus, called a solar furnace, to burn a diamond in a glass jar. By analyzing the residue found in the jar, he was able to show that diamond was comprised solely of carbon. Lavoisier first listed it as an element in his textbook Traité Élémentaire de Chimie, published in 1789. The name carbon derives from the French charbon, or coal.

4. IT LOVES TO BOND.

It can form four bonds, which it does with many other elements, creating hundreds of thousands of compounds, some of which we use daily. (Plastics! Drugs! Gasoline!) More importantly, those bonds are both strong and flexible.

5. NEARLY 20 PERCENT OF YOUR BODY IS CARBON.

May Nyman, a professor of inorganic chemistry at Oregon State University in Corvallis, Oregon tells Mental Floss that carbon has an almost unbelievable range. "It makes up all life forms, and in the number of substances it makes, the fats, the sugars, there is a huge diversity," she says. It forms chains and rings, in a process chemists call catenation. Every living thing is built on a backbone of carbon (with nitrogen, hydrogen, oxygen, and other elements). So animals, plants, every living cell, and of course humans are a product of catenation. Our bodies are 18.5 percent carbon, by weight.

And yet it can be inorganic as well, Nyman says. It teams up with oxygen and other substances to form large parts of the inanimate world, like rocks and minerals.

6. WE DISCOVERED TWO NEW FORMS OF IT ONLY RECENTLY.

Carbon is found in four major forms: graphite, diamonds, fullerenes, and graphene. "Structure controls carbon's properties," says Nyman.  Graphite ("the writing stone") is made up of loosely connected sheets of carbon formed like chicken wire. Penciling something in actually is just scratching layers of graphite onto paper. Diamonds, in contrast, are linked three-dimensionally. These exceptionally strong bonds can only be broken by a huge amount of energy. Because diamonds have many of these bonds, it makes them the hardest substance on Earth.

Fullerenes were discovered in 1985 when a group of scientists blasted graphite with a laser and the resulting carbon gas condensed to previously unknown spherical molecules with 60 and 70 atoms. They were named in honor of Buckminster Fuller, the eccentric inventor who famously created geodesic domes with this soccer ball–like composition. Robert Curl, Harold Kroto, and Richard Smalley won the 1996 Nobel Prize in Chemistry for discovering this new form of carbon.

The youngest member of the carbon family is graphene, found by chance in 2004 by Andre Geim and Kostya Novoselov in an impromptu research jam. The scientists used scotch tape—yes, really—to lift carbon sheets one atom thick from a lump of graphite. The new material is extremely thin and strong. The result: the Nobel Prize in Physics in 2010.

7. DIAMONDS AREN'T CALLED "ICE" BECAUSE OF THEIR APPEARANCE.

Diamonds are called "ice" because their ability to transport heat makes them cool to the touch—not because of their look. This makes them ideal for use as heat sinks in microchips. (Synthethic diamonds are mostly used.) Again, diamonds' three-dimensional lattice structure comes into play. Heat is turned into lattice vibrations, which are responsible for diamonds' very high thermal conductivity.

8. IT HELPS US DETERMINE THE AGE OF ARTIFACTS—AND PROVE SOME OF THEM FAKE.

American scientist Willard F. Libby won the Nobel Prize in Chemistry in 1960 for developing a method for dating relics by analyzing the amount of a radioactive subspecies of carbon contained in them. Radiocarbon or C14 dating measures the decay of a radioactive form of carbon, C14, that accumulates in living things. It can be used for objects that are as much as 50,000 years old. Carbon dating help determine the age of Ötzi the Iceman, a 5300-year-old corpse found frozen in the Alps. It also established that Lancelot's Round Table in Winchester Cathedral was made hundreds of years after the supposed Arthurian Age.

9. TOO MUCH OF IT IS CHANGING OUR WORLD.

Carbon dioxide (CO2) is an important part of a gaseous blanket that is wrapped around our planet, making it warm enough to sustain life. But burning fossil fuels—which are built on a carbon backbone—releases more carbon dioxide, which is directly linked to global warming. A number of ways to remove and store carbon dioxide have been proposed, including bioenergy with carbon capture and storage, which involves planting large stands of trees, harvesting and burning them to create electricity, and capturing the CO2 created in the process and storing it underground. Yet another approach that is being discussed is to artificially make oceans more alkaline in order to let them to bind more CO2. Forests are natural carbon sinks, because trees capture CO2 during photosynthesis, but human activity in these forests counteracts and surpasses whatever CO2 capture gains we might get. In short, we don't have a solution yet to the overabundance of C02 we've created in the atmosphere.

Original image
iStock
arrow
science
Last Month Was the Second-Warmest October on Record
Original image
iStock

After an unseasonably toasty October, the numbers are in: Temperatures exceeded averages across the globe last month, making it the second-hottest October ever recorded, according to NASA.

As Mashable reports, worldwide temperatures reached 1.62°F (or 0.90°C) above the average in October. It just edged out global temperatures in October 2016 and came short of the all-time October record set in 2015. But while El Niño contributed to temperature spikes in 2015, there's no weather event to explain the anomaly this time around.

Records of global mean surface temperature changes date back to 1880. Of the 136 years in NASA’s database, the past three years (2014, 2015, 2016) have produced the greatest temperature anomalies. With the end of the year approaching, it looks like 2017 will end up breaking into the top three, and will likely be the warmest non-El Niño year on record.

While alarming, the record-breaking statistics shouldn't be surprising to anyone who follows global climate trends. The Earth has been warming at a rapid rate in recent decades, and climate scientists blame the carbon dioxide being dumped into the atmosphere by human activity.

Following a hot autumn, the next few months aren't looking to be any cooler: Like last winter and the winter before that, this season is expected to be unusually warm.

[h/t Mashable]

SECTIONS

arrow
LIVE SMARTER
More from mental floss studios