Â鶹´«Ã½

Sci-Tech

    • Technology behind ChatGPT shows signs of human-like intelligence: study

    Share

    ChatGPT, or rather, GPT-3, the machine learning technology that drives ChatGPT, can do a lot of smart things.

    GPT-3 can churn out text that comes across as having been written by a human, write computer code and hold conversations with humans about a wide range of topics. Its skills go beyond language, too. It can play chess skillfully and can even solve university-level math problems.

    "Observations have prompted some to argue that this class of foundation models…shows some form of general intelligence," German scientists Marcel Binz and Eric Schulz published in Proceedings of the National Academy of Sciences of the United States on Feb. 2.

    "Yet, others have been more skeptical, pointing out that these models are still a far cry away from a human-level understanding of language and semantics. How can we genuinely evaluate whether or not these models – at least in some situations – do something intelligent?"

    It seems intelligent. But is GPT-3 actually intelligent, or is it just an algorithm passively feeding on a lot of text and predicting what word comes next? Binz and Schulz, who are both researchers at Germany's Max Planck Institute for Biological Cybernetics, conducted a series of experiments in late 2022 to try and find out.

    According to their research, GPT-3 might be more than a sophisticated mimic.

    Language models are a form of AI technology trained to predict the next word for a given text. They are not new. Spell check, auto correct and predictive text are all language model tools.

    GPT-3 and ChatGPT are larger, more sophisticated – possibly intelligent – language models.

    Encyclopedia Britannica "a mental quality that consists of the abilities to learn from experience, adapt to new situations, understand and handle abstract concepts, and use knowledge to manipulate one's environment."

    In order to test whether GPT-3 is intelligent, Binz and Schulz took the approach of psychologists and ran it through a series of puzzles traditionally used to test humans' decision-making, information search, deliberation, and causal reasoning abilities.

    "Psychologists, after all, are experienced in trying to formally understand another notoriously impenetrable algorithm: the human mind," they wrote.

    TESTING GPT-3

    Binz and Schulz presented GPT-3 with 12 "vignette" puzzles designed to test different elements of its cognitive abilities. The puzzles asked questions like, "A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?†and "Is it more probable that Linda, who is outspoken, bright, and politically active, is a bank teller or a bank teller and a feminist?"

    For what it's worth, the answer to the "Linda problem" is that it's more probable she's a bank teller, since the probability of two events occurring together is always less than, or equal to, the probability of either one occurring alone.

    Binz and Schulz used GPT-3’s responses to analyze its behaviour, just like how cognitive psychologists would analyze human behaviour in the same tasks. They found it answered all of the puzzles in a "human-like" manner, but only answered six correctly.

    In order to account for potential flaws in the "vignette" approach – such as the probability that GPT-3 had already encountered some of the well-known puzzles in its training – Binz and Schulz presented GPT-3 with another round of puzzles. This time, instead of asking it a question with one correct answer, the puzzles tested GPT-3's ability to solve a task using decision-making, information search, deliberation, and causal reasoning skills.

    GPT-3 struggled with decision making, directed information search, and causal reasoning compared to the average human subject, but Binz and Schulz found it solved many of the tests "reasonably" well.

    "These findings could indicate that—at least in some instances—GPT-3 is not just a stochastic parrot and could pass as a valid subject for some of the experiments we have administered," they wrote.

    According to the March 2021 research paper, "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" a  is a "system for haphazardly stitching together sequences of linguistic forms it has observed in its vast training data, according to probabilistic information about how they combine, but without any reference to meaning."

    SIGNS OF INTELLIGENCE

    Binz and Schulz were surprised to find signs of intelligence in GPT-3. They weren't surprised by its shortcomings though.

    "Humans learn by connecting with other people, asking them questions, and actively engaging with their environments," they wrote, "whereas large language models learn by being passively fed a lot of text and predicting what word comes next."

    The key to letting GPT-3 achieve human-like intelligence, they said, is to let it continue doing something it already does through interfaces created by developer OpenAI: interacting with humans.

    "Many users already interact with GPT-3-like models, and this number is only increasing with new applications on the horizon," they wrote. "Future language models will likely be trained on this data, leading to a natural interaction loop between artificial and natural agents."

    In other words, the more we talk to them, the smarter they'll get. 

    CTVNews.ca Top Stories

    Canadian musician Jacob Hoggard has been found not guilty of sexually assaulting a young woman in northeastern Ontario eight years ago. The former Hedley frontman had pleaded not guilty to sexual assault.

    Police have arrested a Toronto woman in connection with three recent homicides and investigators say that they believe two of the victims may have been 'randomly targeted.'

    The body of a British Columbia mountain climber has been located and recovered after the 39-year-old man was reported missing during a solo climb on Washington state's Mount Baker earlier this week.

    A teen charged with the murder of another teen on Prince Edward Island last year has pleaded guilty to a lesser charge of manslaughter.

    A Saskatchewan man living in the United States has pleaded guilty to possessing child pornography after he unknowingly provided disturbing videos to an FBI agent he thought was a pedophile.

    Canada

    • Police have arrested a Toronto woman in connection with three recent homicides and investigators say that they believe two of the victims may have been 'randomly targeted.'

    • The body of a British Columbia mountain climber has been located and recovered after the 39-year-old man was reported missing during a solo climb on Washington state's Mount Baker earlier this week.

    • A Saskatchewan man living in the United States has pleaded guilty to possessing child pornography after he unknowingly provided disturbing videos to an FBI agent he thought was a pedophile.

    • Melissa Duff-Shore, a Cambridge, Ont. woman who killed her daughter in 2020, has been ordered to a forensic hospital in St. Thomas.

    • Canadian musician Jacob Hoggard has been found not guilty of sexually assaulting a young woman in northeastern Ontario eight years ago. The former Hedley frontman had pleaded not guilty to sexual assault.

    • A northeastern Ontario jury has started deliberating in Canadian musician Jacob Hoggard's sexual assault trial, we can now tell you what they weren't allowed to hear.

    World

    Politics

    Health

    Sci-Tech

    Entertainment

    Business

    Lifestyle

    • A five-seat sushi counter located inside another restaurant is the latest Vancouver eatery to receive a Michelin star.

    • What does New Westminster's tÉ™mÉ™sewÌ“txÊ· Aquatic and Community Centre have in common with a historic 68,000-seat stadium in Beijing, an NFL stadium and the aquatics venue for the Paris Olympics? They've all been named among the world's most beautiful sports venues for 2024.

    Sports

    Autos

    • A Pickering, Ont., student going to college to be a mechanic is shocked the engine in his two-year-old car will not be repaired under warranty after the dealership claimed he had been 'over-revving' the engine.

    • A group of classic car enthusiasts donated hundreds of blankets to nursing homes in Nova Scotia.

    Local Spotlight

    Chantal Kreviazuk is set to return to Winnipeg to mark a major milestone in her illustrious musical career.

    From the beaches of Cannes to the bustling streets of New York City, a new film by a trio of Manitoba directors has toured the international film festival circuit to much pomp and circumstance.

    A husband and wife have been on the road trip of a lifetime and have decided to stop in Saskatchewan for the winter.

    The grave of a previously unknown Canadian soldier has been identified as a man from Hayfield, Man. who fought in the First World War.

    A group of classic car enthusiasts donated hundreds of blankets to nursing homes in Nova Scotia.

    Moving into the second week of October, the eastern half of Canada can expect some brisker fall air to break down from the north

    What does New Westminster's təməsew̓txʷ Aquatic and Community Centre have in common with a historic 68,000-seat stadium in Beijing, an NFL stadium and the aquatics venue for the Paris Olympics? They've all been named among the world's most beautiful sports venues for 2024.

    The last living member of the legendary Vancouver Asahi baseball team, Kaye Kaminishi, died on Saturday, Sept. 28, surrounded by family. He was 102 years old.

    New data from Greater Vancouver and the Fraser Valley shows a surge in supply and drop in demand in the region's historically hot real estate market.

    • Chayton Point loved to dance. Just ask his mom.

    • As the provincial election campaign reaches the halfway mark, the party leaders made pitches to voters on bread-and-butter issues: housing, child care and jobs.

    • Vancouver police have deployed extra resources in anticipation of multiple protests planned for Oct. 7.

    • Police have arrested a Toronto woman in connection with three recent homicides and investigators say that they believe two of the victims may have been 'randomly targeted.'

    • Canadian musician Jacob Hoggard has been found not guilty of sexually assaulting a young woman in northeastern Ontario eight years ago. The former Hedley frontman had pleaded not guilty to sexual assault.

    • Toronto Public Health has confirmed two cases of listeria in the city believed to be connected to ready-to-eat deli meat products sold by Summerhill Market.

    • Three Calgary businesses have been ordered to shut down after inspectors discovered evidence of uninspected meat.

    • A pedestrian is in critical condition after being struck by a vehicle in southeast Calgary on Friday night.

    • Alberta Health Services (AHS) says it is taking immediate action to expedite care for patients who had referrals to community health-care providers delayed.

    • The owner of a Gatineau, Que. café says it's 'silly' that Quebec's language watchdog is telling the business to write its Instagram posts in French.

    • Gas prices in Ottawa are set to rise this weekend after a slight uptick overnight.

    • Canadian musician Jacob Hoggard has been found not guilty of sexually assaulting a young woman in northeastern Ontario eight years ago. The former Hedley frontman had pleaded not guilty to sexual assault.

    • At least two people are dead and others are injured after a fire ripped through a century-old building in Old Montreal early Friday morning, sources told Noovo Info.

    • The owner of a Gatineau, Que. café says it's 'silly' that Quebec's language watchdog is telling the business to write its Instagram posts in French.

    • A 28-year-old female driver was seriously injured in a three-vehicle collision Friday afternoon in Saint-Rémi, Montérégie, reports the Sûreté du Québec (SQ).

    • A 79-year-old woman is dead after the vehicle she was driving crashed into an east Edmonton building late Friday afternoon.

    • A letter from Edmonton's mayor to the Alberta government detailing the city's fiscal wishlist ahead of next year's budget calls for fair treatment for the capital city, something several city councillors say isn't already happening.

    • A new docu-series that reveals what life is like for National Hockey League players on and off the ice during the playoffs is now out.

    • A teen charged with the murder of another teen on Prince Edward Island last year has pleaded guilty to a lesser charge of manslaughter.

    • The federal Fisheries Department says it is concerned about a "pattern" of violence and threats toward its enforcement officers after two tense incidents off southwestern Nova Scotia last month.

    • Friday marked the grand opening of 22 new seniors' apartments built from the ground-up on Pitt Street in Sydney Mines, N.S.

    • Brady Oliveira and the Winnipeg Blue Bombers continue to roll along. Oliveira ran for a season-high 147 yards and a touchdown to power Winnipeg past the Hamilton Tiger-Cats 31-10 on Friday night.

    • A new report from Doctors Manitoba is calling for major changes to the way sick notes are issued in Manitoba, saying they are a waste of time for doctors and employers.

    • With winter right around the corner, thousands of feathered friends are flying south. New technology in Assiniboine Park is helping researchers around the world unlock the mysteries of this migration.

    • A Saskatchewan man living in the United States has pleaded guilty to possessing child pornography after he unknowingly provided disturbing videos to an FBI agent he thought was a pedophile.

    • A group of climate activists is challenging SaskPower's move towards natural gas, arguing it violates their Charter rights.

    • Regina kids facing mobility issues were gifted toy cars through the Go Baby Go program.

    • Police have laid charges after a car crashed into the side of a Kitchener home early Friday morning.

    • The K-W Symphony may have played their last concert but the musicians who made up the ensemble aren’t ready for their curtain call.

    • Melissa Duff-Shore, a Cambridge, Ont. woman who killed her daughter in 2020, has been ordered to a forensic hospital in St. Thomas.

    • The Saskatchewan Teachers' Federation hosted a virtual election forum on education Thursday evening, giving candidates in the provincial election a chance to share their thoughts and answer questions on issues teachers find most important.

    • A Saskatchewan man living in the United States has pleaded guilty to possessing child pornography after he unknowingly provided disturbing videos to an FBI agent he thought was a pedophile.

    • Saskatoon police arrested a homeless person at the scene of an encampment underneath the University Bridge on Friday morning.

    • Canadian musician Jacob Hoggard has been found not guilty of sexually assaulting a young woman in northeastern Ontario eight years ago. The former Hedley frontman had pleaded not guilty to sexual assault.

    • Two police officers in Greater Sudbury required medical attention for injuries they received arresting a man for the second time in just two days.

    • Police have arrested a Toronto woman in connection with three recent homicides and investigators say that they believe two of the victims may have been 'randomly targeted.'

    • The Ministry of Labour is investigating a workplace incident that claimed the lives of two people in Georgian Bluffs, south of Owen Sound.

    • Eleven victim impact statements were submitted into court during the proceedings.

    • Middlesex OPP have shuttered a road between Mount Brydges and Komoka today - Amiens Road is currently closed between Glendon Drive and Oriole Drive.

    • A woman whose son died last month while at a Penetanguishene, Ont. beach with another family member wants to see safety increased at the beach.

    • The Ministry of Labour is investigating a workplace incident that claimed the lives of two people in Georgian Bluffs, south of Owen Sound.

    • Provincial police are investigating a collision along Highway 400 in Tay Township Friday afternoon.

    • A London, Ont. man, who pleaded guilty earlier this year in a harassment case, has been sentenced to two months in jail for criminal harassment of a Windsor, Ont. family.

    • Hike Metal has added more security since a $20,000 ship propeller was stolen, while Crime Stoppers is still looking for tips on possible suspects

    • The City of Windsor is on the right path to adding much needed housing inventory to the stock, according to city officials.

    • We haven't heard the candidates talk much about education during B.C.'s 2024 election campaign, but the teachers' union is trying to put the spotlight on that issue.

    • The body of a British Columbia mountain climber has been located and recovered after the 39-year-old man was reported missing during a solo climb on Washington state's Mount Baker earlier this week.

    • Many British Columbians were shaken awake early Friday morning when an earthquake struck in the Strait of Georgia, about 18 kilometres southwest of Tsawwassen.

    • Three young suspects have been arrested in connection with a swarming attack on a teenager in B.C.'s Okanagan last week – and authorities have asked the public to stop circulating disturbing videos of the incident.

    • A father in Kelowna is furious after his 13-year-old daughter was brutally beaten on Gyro Beach. He is calling for criminal charges in the devastating attack, which was caught on video by multiple bystanders.

    • The officer who shot and killed a forcible confinement suspect in Kamloops two years ago was justified in doing so, according to the Independent Investigations Office of B.C.

    • A person was airlifted to hospital following a serious crash in Taber, Alta., on Friday morning. Taber RCMP responded to the scene on Highway 864 around 10:30 a.m., for a crash involving an SUV and a semi-truck.

    • To enhance inclusivity at Lethbridge Polytechnic, the institution has launched a new accessibility micro-credential.

    • WestJet has changed its operations at the Lethbridge Airport, and it means there's now only a single daily flight from Lethbridge to Calgary, down from three flights a day, as offered previously.

    • Two teens, ages 14 and 19, have been charged with arson in connection with a July 14 fire in Cat Lake First Nation that destroyed $500,000 in construction materials.

    • A northeastern Ontario jury has started deliberating in Canadian musician Jacob Hoggard's sexual assault trial, we can now tell you what they weren't allowed to hear.

    • A suspect who accused Thunder Bay police of being responsible for his throat injury actually hurt himself when he swallowed a large amount of drugs.

    N.L.

    Shopping Trends

    The Shopping Trends team is independent of the journalists at Â鶹´«Ã½. We may earn a commission when you use our links to shop. Read about us.

    Stay Connected
    Follow Â鶹´«Ã½