15 Positively Reinforcing Facts About B.F. Skinner

Silly rabbit via Wikimedia Commons // CC BY 3.0
Silly rabbit via Wikimedia Commons // CC BY 3.0

B.F. (Burrhus Frederic) Skinner was one of the preeminent American psychologists of the 20th century. Skinner founded “radical behaviorism”—a twist on traditional behaviorism, a field of psychology that focused exclusively on observable human behavior. Thoughts, feelings, and perceptions were cast aside as unobservable.

Skinner dubbed his own method of observing behavior “operant conditioning,” which posited that behavior is determined solely by its consequences—either reinforcements or punishments. He argued that people can be manipulated to exhibit or inhibit a behavior based on these consequences.

To Skinner’s critics, the idea that these “principles of reinforcement,” as he called them, lead to easy “behavior modification” suggested that we do not have free will and are little more than automatons acting in response to stimuli. But his fans considered him visionary. Controversial to the end, Skinner was well known for his unconventional methods, unusual inventions, and utopian—some say dystopian—ideas about human society.

1. HE INVENTED THE "OPERANT CONDITIONING" OR "SKINNER" BOX.

Skinner believed that the best way to understand behavior is to look at the causes of an action and its consequences. He called this approach “operant conditioning.” Skinner began by studying rats interacting with an environment inside a box, where they were rewarded with a pellet of food for responding to a stimulus like light or sound with desired behavior. This simple experiment design would over the years take on dark metaphorical meaning: Any environment that had mechanisms in place to manipulate or control behavior could be called a "Skinner box." Recently, some have argued that social media is a sort of digital Skinner box: Likes, clicks, and shares are the pellet-like rewards we get for responding to our environment with certain behavior. Yes, we are the rats.

2. HE BELIEVED ALL BEHAVIOR WAS AFFECTED BY ONE OF THREE "OPERANTS."

Skinner proposed there were only three “operants” that had affected human behavior. Neutral operants were responses from the environment that had a benign effect on a behavior. Reinforcers were responses that increased the likelihood of a behavior’s repetition. And punishers decreased the likelihood of a behavior’s repetition. While he was correct that behavior can be modified via this system, it’s only one of many methods for doing so, and it failed to take into account how emotions, thoughts, and—as we learned eventually—the brain itself account for changes in behavior.

3. HE'S RESPONSIBLE FOR THE TERM "POSITIVE REINFORCEMENT."

Skinner eventually moved on to studying pigeons in his Skinner Box. The pigeons would peck at a disc to gain access to food at various intervals, and for completing certain tasks. From this Skinner concluded that some form of reinforcement was crucial in learning new behaviors. To his mind, positive reinforcement strengthens a behavior by providing a consequence an individual finds rewarding. He concluded that reinforced behavior tends to be repeated and strengthened.

4. SOME CRITICS FELT THIS APPROACH AMOUNTED TO BRIBERY.

Critics were dubious that Skinner's focus on behavior modification through positive reinforcing of desired behavior could actually change behavior for the long term, and that it was little more than temporary reward, like bribery, for a short-term behavioral change.

5. "NEGATIVE REINFORCEMENT" ISN'T WHAT YOU THINK.

Skinner believed negative reinforcement also helped to strengthen behavior; this doesn't mean exposing an animal or person to a negative stimulus, but rather removing an “unpleasant reinforcer.” The idea was that removing the negative stimulus would feel like a “reward” to the animal or person.

6. SKINNER TAUGHT PIGEONS TO PLAY PING-PONG.

As part of his research into positive reinforcement, he taught pigeons to play ping-pong as a first step in seeing how trainable they were. He ultimately wanted to teach them to guide bombs and missiles and even convinced the military to fund his research to that effect. He liked working with pigeons because they responded well to reinforcements and punishments, thus validating his theories. We know now that pigeons can be trained in a whole host of tasks, including distinguishing written words from nonsense and spotting cancer.

7. HIS FIRST BOOK, THE BEHAVIOR OF ORGANISMS, BROKE NEW GROUND.

Published in 1938, Skinner’s debut tome made the case that simple observation of cause and effect, reward and punishment, were as significant to understanding behavior as other “conceptual or neural processes.”

Skinner believed behavior was everything. Thoughts and feelings were just unreliable byproducts of behaviors, he argued—and therefore dismissed them. Many of his fellow psychologists disagreed. Regardless, Skinner’s theories contributed to a greater understanding of the relationship between stimuli and resulting behavior and may have even laid the groundwork for understanding the brain’s reward circuitry, which centers around the amygdala.

8. HE CREATED "THE BABY TENDER."

Skinner was fond of inventions, and having children gave him a new outlet for his tendencies. He designed a special crib for his infant daughter called “the baby tender.” The clear box, with air holes, was heated so that the baby didn't need blankets. Unlike typical cribs, there were no slats in the sides, which he said prevented possible injury. Unsurprisingly, it did not catch on popularly.

9. HE ALSO DEVELOPED HIS OWN "TEACHING MACHINE."


Silly rabbit via Wikimedia Commons // CC BY 3.0

You may have Skinner to thank for modern school workbooks and test-taking procedures. In 1954 Skinner visited his daughter’s classroom and found himself frustrated with the “inefficiencies” of the teaching procedures. His first "teaching machine"—a very basic program to improve teaching methods for spelling, math, and other school subjects—was little more than a fill-in-the-blank method on workbook or computer. It’s now considered a precursor to computer-assisted learning programs.

10. SKINNER IMAGINED AN IDEAL SOCIETY BASED ON HIS THEORIES OF HUMAN BEHAVIOR.

Skinner admired Henry David Thoreau’s famous book Walden, in which Thoreau writes about his retreat to the woods to get in greater contact with his inner nature. Skinner's "Ten Commandments" for a utopian world include: “(1) No way of life is inevitable. Examine your own closely. (2) If you do not like it, change it. (3) But do not try to change it through political action. Even if you succeed in gaining power, you will not likely be able to use it any more wisely than your predecessors. (4) Ask only to be left alone to solve your problems in your own way. (5) Simplify your needs. Learn how to be happy with fewer possessions.”

11. HE WROTE A UTOPIAN NOVEL, WALDEN TWO.

Alex from Ithaca, NY, via Wikimedia Commons // CC BY 2.0

Though inspired by Walden, Skinner also felt the book was too self-indulgent, so he wrote his own fictional follow-up with the 1948 novel Walden Two. The book proposed a type of utopian—some say dystopian—society that employed a system of behavior modification based on operant conditioning. This system of rewards and punishments would, Skinner proposed, make people into good citizens:

“We can achieve a sort of control under which the controlled, though they are following a code much more scrupulously than was ever the case under the old system, nevertheless feel free. They are doing what they want to do, not what they are forced to do. That's the source of the tremendous power of positive reinforcement—there's no restraint and no revolt. By careful cultural design, we control not the final behavior, but the inclination to behave—the motives, desires, the wishes.”

12. SOME FELT HIS IDEAS WERE REDUCTIONIST …

Critics, of which there were many, felt he reduced human behavior to a series of actions and reactions: that an individual human “mind” only existed in a social context, and that humans could be easily manipulated by external cues. He did not put much store in his critics. Even at age 83, just three years before he died, he told Daniel Goleman in a 1987 New York Times article, “I think cognitive psychology is a great hoax and a fraud, and that goes for brain science, too. They are nowhere near answering the important questions about behavior.”

13. … OR WORSE. HIS ACADEMIC COLLEAGUES WERE HORRIFIED BY WALDEN TWO.

Astronomer and colleague JK Jessup's reaction is a good example of their take on his idealized world. Jessup wrote, “Skinner's utopian vision could change the nature of Western civilization more disastrously than the nuclear physicists and biochemists combined.”

14. HE IMPLIED THAT HUMANS HAD NO FREE WILL OR INDIVIDUAL CONSCIOUSNESS.

In the late 1960s and early '70s, Skinner wrote several works applying his behavioral theories to society, including Beyond Freedom and Dignity (1971). He drew fire for implying that humans had no free will or individual consciousness but could simply be controlled by reward and punishment. His critics shouldn't have been surprised: This was the very essence of his behaviorism. He, however, was unconcerned with criticism. His daughter Julie S. Vargas has written that “Skinner felt that by answering critics (a) you showed that their criticism affected you; and (b) you gave them attention, thus raising their reputation. So he left replies to others.”

15. HE DIED CONVINCED THAT THE FATE OF HUMANITY LAY IN APPLYING HIS METHODS OF BEHAVIORAL SCIENCE TO SOCIETY.

In 1990, he died of leukemia at age 86 after receiving a Lifetime Achievement Award from the American Psychological Association. Proud of his work, he was nonetheless concerned about the fate of humanity and worried “about daily life in Western culture, international conflict and peace, and why people were not acting to save the world.”

10 Electrifying Facts About Michael Faraday

iStock
iStock

This world-changing genius was born into poverty on September 22, 1791. Fortunately for us, Michael Faraday refused to let his background stand in his way.

1. HE WAS LARGELY SELF-EDUCATED.

In Faraday's boyhood home, money was always tight. His father, James, was a sickly blacksmith who struggled to support a wife and four children in one of London's poorer outskirts. At age 13, young Faraday started helping the family make ends meet. Bookseller George Ribeau (sometimes spelled Riebau) took him on as an errand boy in 1804, with the teen's primary job being the delivery and recovery of loaned-out newspapers.

Shortly after Faraday's 14th birthday, Ribeau offered him a free apprenticeship. Over the next seven years, he mastered the trade of bookbinding. After hours, Faraday remained in Ribeau's store, hungrily reading many of the same volumes he'd bound together.

Like most lower-class boys, Faraday's formal schooling was very limited. Between those bookshelves, however, he taught himself a great deal—especially about chemistry, physics, and a mysterious force called "electricity."

2. A 300-PAGE NOTEBOOK LAUNCHED HIS SCIENTIFIC CAREER.


Wikimedia Commons // CC BY 4.0 

Sir Humphry Davy (above) left a huge mark on science. In the year 1808 alone, the man discovered no less than five elements, including calcium and boron. An excellent public speaker, Davy's lectures at the Royal Institution consistently drew huge crowds. 

Twenty-year-old Faraday attended four of these presentations in 1812, having received tickets from a customer. As Davy spoke, Faraday jotted down detailed notes, which he then compiled and bound into a little book. Faraday sent his 300-page transcript to Davy. Duly impressed, the seasoned scientist eventually hired him as a lab assistant. Later in life, Davy was asked to name the greatest discovery he'd ever made. His answer: "Michael Faraday."

Tension would nevertheless erupt between mentor and protégé. As Faraday's accomplishments began to eclipse his own, Davy accused the younger man of plagiarizing another scientist's work (this rumor was swiftly discredited) and tried to block his admission to the Royal Society.

3. IF IT WEREN'T FOR FARADAY, WE MIGHT NOT HAVE ELECTRIC POWER.

On September 3, 1821, Faraday built a device that ushered technology into the modern era. One year earlier, Danish physicist Hans Christian Ørsted had demonstrated that when an electric current flows through a wire, a magnetic field is created around it. Faraday capitalized on this revelation. Inside the Royal Society basement, he began what was arguably his most groundbreaking experiment by placing a magnet in the bottom of a mercury-filled glass container. Dangling overhead was a wire, which Faraday connected to a battery. Once an electric current was conducted through the wire, it began rotating around the magnet.

Faraday had just built the world's first electric motor. How could he possibly top himself? By building the world's first electric generator. His first experiment was comprised of a simple ring of wires and cotton through which he passed a magnet. By doing so, he found that a current was generated. To this day, most electricity is made using the same principles.

4. FARADAY INVENTED THE RUBBER BALLOON.


iStock

By today's standards, his early models would look shabby. Made via pressing two sheets of rubber together, Faraday's balloons were used to contain hydrogen during his experiments. Faraday created his first in 1824 and was quick to praise the bag's “considerable ascending power.” Toy manufacturers started distributing these the following year.

5. HE'S ALSO THE GRANDFATHER OF MODERN REFRIGERATORS.

In 1823, Faraday sealed a sample of chlorine hydrate inside a V-shaped tube. As he heated one end and cooled the other simultaneously, the scientist noticed that a peculiar yellow liquid was starting to form. Curious, he broke open the tube. Without warning, a sudden, violent explosion sent glass shards flying everywhere. Mercifully uninjured, he smelled a strong scent of chlorine in the air.

It didn't take him very long to figure out what had happened. Inside the tube, pressure was building, which liquefied the gas. Upon puncturing the glass, he'd released this pressure and, afterwards, the liquid reverted into its gaseous state. This sudden evaporation came with an interesting side-effect: it cooled down the surrounding air. Quite unintentionally, Faraday thus set the stage for the very first ice-making machines and refrigeration units.

6. HE BECAME AN ANTI-POLLUTION CRUSADER.

Britain's industrialization came at a malodorous price. As London grew more crowded during the mid-1800s, garbage and fecal matter were dumped into the River Thames with increasing regularity. Naturally, the area didn't smell like a rose. In 1855, Faraday penned an oft-reproduced open letter about the problem, imploring the authorities to take action. “If we neglect this subject,” he wrote, “we cannot expect to do so with impunity; nor ought we be surprised if, ere many years are over, a hot season give us sad proof for the folly of our carelessness.”

Just as Faraday predicted, a broiling summer forced Londoners of all stripes to hold their noses. Dubbed “the Great Stink,” the warmer months of 1858 sent the Thames' rancid odor wafting all over the city. Parliament hastily responded with a comprehensive sewage reform bill. Gradually, the putrid stench began to dissipate.

7. HE STARTED THE ROYAL SOCIETY'S CHRISTMAS LECTURE TRADITION.


Alexander Blaikley, Wikimedia Commons, Public Domain

Faraday understood the importance of making science accessible to the public. In 1825, while employed by the Royal Society, he spearheaded an annual series that's still going strong today. That holiday season, engineer John Millington delivered a set of layman-friendly lectures on “natural philosophy.” Every year thereafter (excluding 1939–1942 because of WWII), a prominent scientist has been invited to follow in his footsteps. Well-known Christmas lecturers include David Attenborough (1973), Carl Sagan (1977), and Richard Dawkins (1991). Faraday himself was the presenter on no less than 19 occasions.

8. BRILLIANT AS FARADAY WAS, HE STRUGGLED WITH MATH.

Towards the end of his life, Faraday's lack of formal education finally caught up with him. An underprivileged childhood had rendered him mathematically illiterate, a severe handicap for a professional scientist. In 1846, he hypothesized that light itself is an electromagnetic phenomenon, but because Faraday couldn't support the notion with mathematics, it wasn't taken seriously. Salvation for him came in the form of a young physicist named James Clerk Maxwell. Familial wealth had enabled Maxwell to pursue math and—in 1864—he released equations [PDF] that helped prove Faraday's hunch.

9. AS TIME WORE ON, HE STRUGGLED WITH MEMORY LOSS.

Michael Faraday
iStock

At the age of 48, Faraday's once-sharp memory started faltering. Stricken by an illness that rendered him unable to work for three years, he wrestled with vertigo, unsteadiness, and other symptoms. Following this "extended vacation" [PDF], he returned to the Royal Society, where he experimented away until his early 70s.

However, Faraday was still prone to inexplicable spurts of sudden giddiness, depression, and extreme forgetfulness. “[My] bad memory,” he wrote, “both loses recent things and sometimes suggests old ones as new.” Nobody knows what caused this affliction, though some blame it on overexposure to mercury.

10. EINSTEIN KEPT A PORTRAIT OF FARADAY IN HIS BERLIN HOME.

Fittingly, the father of modern physics regarded Faraday as a personal hero. Once, upon receiving a book about him, Einstein remarked, “This man loved mysterious Nature as a lover loves his distant beloved.”

Fossilized Fat Shows 550-Million-Year-Old Sea Creature May Have Been the World's First Animal

Ilya Bobrovskiy, the Australian National University
Ilya Bobrovskiy, the Australian National University

A bizarre sea creature whose fossils look like a cross between a leaf and a fingerprint may be Earth's oldest known animal, dating back 558 million years.

As New Scientist reports, researchers from the Australian National University (ANU) made a fortunate find in a remote region of Russia: a Dickinsonia fossil with fat molecules still attached. These odd, oval-shaped creatures were soft-bodied, had rib structures running down their sides, and grew about 4.5 feet long. They were as “strange as life on another planet,” researchers wrote in the abstract of a new paper published in the journal Science.

Another variety of fossil
Ilya Bobrovskiy, the Australian National University

Although Dickinsonia fossils were first discovered in South Australia in 1946, researchers lacked the organic matter needed to classify this creature. "Scientists have been fighting for more than 75 years over what Dickinsonia and other bizarre fossils of the Edicaran biota were: giant single-celled amoeba, lichen, failed experiments of evolution, or the earliest animals on Earth,” senior author Jochen Brocks, an associate professor at ANU, said in a statement.

With the discovery of cholesterol molecules—which are found in almost all animals, but not in other organisms like bacteria and amoebas—scientists can say that Dickinsonia were animals. The creatures swam the seas during the Ediacaran Period, 635 million to 542 million years ago. More complex organisms like mollusks, worms, and sponges didn’t emerge until 20 million years later.

The fossil with fat molecules was found on cliffs near the White Sea in an area of northwest Russia that was so remote that researchers had to take a helicopter to get there. Collecting the samples was a death-defying feat, too.

“I had to hang over the edge of a cliff on ropes and dig out huge blocks of sandstone, throw them down, wash the sandstone, and repeat this process until I found the fossils I was after,” lead author Ilya Bobrovskiy of ANU said. Considering that this find could change our understanding of Earth’s earliest life forms, it seems the risk was worth it.

[h/t New Scientist]

SECTIONS

arrow
LIVE SMARTER