CLOSE
iStock
iStock

AI Algorithm Tells You the Ingredients in Your Meal Based on a Picture

iStock
iStock

Your food photography habit could soon be good for more than just updating your Instagram. As Gizmodo reports, a new AI algorithm is trained to analyze food photos and match them with a list of ingredients and recipes.

The tool was developed by researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL). To build it, they compiled information from sites like All Recipes and Food.com into a database dubbed Recipe1M, according to their paper. With more than a million annotated recipes at its disposal, a neural network then sifted through each one, learning about which ingredients are associated with which types of images along the way.

The result is Pic2Recipe, an algorithm that can deduce key details about a food item just by looking at its picture. Show it a picture of a cookie, for example, and it will tell you it likely contains sugar, butter, eggs, and flour. It will also recommend recipes for something similar pulled from the Recipe1M database.

Pic2Recipe is still a work in progress. While it has had success with simple recipes, more complicated items—like smoothies or sushi rolls, for example—seem to confuse the system. Overall, it suggests recipes with an accuracy rate of about 65 percent.

Researchers see their creation being used as a recipe search engine or as a tool for situations where nutritional information is lacking. “If you know what ingredients went into a dish but not the amount, you can take a photo, enter the ingredients, and run the model to find a similar recipe with known quantities, and then use that information to approximate your own meal,” lead author Nick Hynes told MIT News.

Before taking the project any further, the team plans to present its work at the Computer Vision and Pattern Recognition Conference in Honolulu later this month.

[h/t Gizmodo]

nextArticle.image_alt|e
NUS Environmental Research Institute, Subnero
arrow
technology
Researchers in Singapore Deploy Robot Swans to Test Water Quality
NUS Environmental Research Institute, Subnero
NUS Environmental Research Institute, Subnero

There's something peculiar about the new swans floating around reservoirs in Singapore. They drift across the water like normal birds, but upon closer inspection, onlookers will find they're not birds at all: They're cleverly disguised robots designed to test the quality of the city's water.

As Dezeen reports, the high-tech waterfowl, dubbed NUSwan (New Smart Water Assessment Network), are the work of researchers at the National University of Singapore [PDF]. The team invented the devices as a way to tackle the challenges of maintaining an urban water source. "Water bodies are exposed to varying sources of pollutants from urban run-offs and industries," they write in a statement. "Several methods and protocols in monitoring pollutants are already in place. However, the boundaries of extensive assessment for the water bodies are limited by labor intensive and resource exhaustive methods."

By building water assessment technology into a plastic swan, they're able to analyze the quality of the reservoirs cheaply and discreetly. Sensors on the robots' undersides measure factors like dissolved oxygen and chlorophyll levels. The swans wirelessly transmit whatever data they collect to the command center on land, and based on what they send, human pilots can remotely tweak the robots' performance in real time. The hope is that the simple, adaptable technology will allow researchers to take smarter samples and better understand the impact of the reservoir's micro-ecosystem on water quality.

Man placing robotic swan in water.
NUS Environmental Research Institute, Subnero

This isn't the first time humans have used robots disguised as animals as tools for studying nature. Check out this clip from the BBC series Spy in the Wild for an idea of just how realistic these robots can get.

[h/t Dezeen]

nextArticle.image_alt|e
REM-Fit
arrow
Live Smarter
Stop Your Snoring and Track Your Sleep With a Wi-Fi Smart Pillow
REM-Fit
REM-Fit

Everyone could use a better night's rest. The CDC says that only 66 percent of American adults get as much sleep as they should, so if you're spending plenty of time in bed but mostly tossing and turning (or trying to block out your partner's snores), it may be time to smarten up your sleep accessories. As TechCrunch reports, the ZEEQ Smart Pillow improves your sleeping schedule in a multitude of ways, whether you're looking to quiet your snores or need a soothing lullaby to rock you to sleep.

After a successful Kickstarter in 2016, the product is now on sale and ready to get you snoozing. If you're a snorer, the pillow has a microphone designed to listen to the sound of your snores and softly vibrate so that you shift positions to a quieter pose. Accelerometers in the pillow let the sleep tracker know how much you're moving around at night, allowing it to record your sleep stages. Then, you can hook the pillow up to your Amazon Echo or Google Home so that you can have your favorite smart assistant read out the pillow's analysis of your sleep quality and snoring levels the next morning.

The pillow is also equipped with eight different wireless speakers that turn it into an extra-personal musical experience. You can listen to soothing music while you fall asleep, either connecting the pillow to your Spotify or Apple Music account on your phone via Bluetooth or using the built-in relaxation programs. You can even use it to listen to podcasts without disturbing your partner. You can set a timer to turn the music off after a certain period so you don't wake up in the middle of the night still listening to Serial.

And when it's time to wake up, the pillow will analyze your movements to wake you during your lightest sleep stage, again keeping the noise of an alarm from disturbing your partner.

The downside? Suddenly your pillow is just another device with a battery that needs to charge. And forget about using it in a place without Wi-Fi.

The ZEEQ Smart Pillow currently costs $200.

[h/t TechCrunch]

SECTIONS

arrow
LIVE SMARTER
More from mental floss studios