Â鶹´«Ã½

Skip to main content

Meta releases AI model that can identify items within images

A Facebook employee takes a photo of the Meta Platforms Inc. sign outside the company headquarters in Menlo Park, Calif., on Oct. 28, 2021. (Tony Avelar / AP) A Facebook employee takes a photo of the Meta Platforms Inc. sign outside the company headquarters in Menlo Park, Calif., on Oct. 28, 2021. (Tony Avelar / AP)
Share

Facebook-owner on Wednesday that can pick out individual objects from within an image, along with a dataset of image annotations that it said was the largest ever of its kind.

The company's research division said in a blog post that its Segment Anything Model, or SAM, could identify objects in images and videos even in cases where it had not encountered those items in its training.

Using SAM, objects can be selected by clicking on them or writing text prompts. In one demonstration, writing the word "cat" prompted the tool to draw boxes around each of several cats in a photo.

Big tech companies have been trumpeting their artificial intelligence breakthroughs since Microsoft-backed OpenAI's ChatGPT chatbot became a sensation in the fall, triggering a wave of investments and a race to dominate the space.

Meta has teased several features that deploy the type of generative AI popularized by ChatGPT, which creates brand new content instead of simply identifying or categorizing data like other AI, although it has not yet released a product.

Examples include a tool that spins up surrealist videos from text prompts and another that generates children's book illustrations from prose.

Chief Executive Mark Zuckerberg has said that incorporating such generative AI "creative aids" into Meta's apps is a priority this year.

Meta does already use technology similar to SAM internally for activities like tagging photos, moderating prohibited content and determining which posts to recommend to users of Facebook and Instagram.

The company said SAM's release would broaden access to that type of technology.

The SAM model and dataset will be available for download under a non-commercial license. Users uploading their own images to an accompanying prototype likewise must agree to use it only for research purposes.

Reporting by Katie Paul; Editing by Conor Humphries

CTVNews.ca Top Stories

A team of tornado experts is heading to Fergus, Ont. after a storm ripped through the area Sunday night.

Why brain aging can vary dramatically between people

Researchers are uncovering deeper insights into how the human brain ages and what factors may be tied to healthier cognitive aging, including exercising, avoiding tobacco, speaking a second language or even playing a musical instrument.

Local Spotlight

For the second year in a row, the ‘Gift-a-Family’ campaign is hoping to make the holidays happier for children and families in need throughout Barrie.

Some of the most prolific photographers behind CTV Skywatch Pics of the Day use the medium for fun, therapy, and connection.

A young family from Codroy Valley, N.L., is happy to be on land and resting with their newborn daughter, Miley, after an overwhelming, yet exciting experience at sea.

As Connor Nijsse prepared to remove some old drywall during his garage renovation, he feared the worst.

A group of women in Chester, N.S., has been busy on the weekends making quilts – not for themselves, but for those in need.

A Vancouver artist whose streetside singing led to a chance encounter with one of the world's biggest musicians is encouraging aspiring performers to try their hand at busking.

Ten-thousand hand-knit poppies were taken from the Sanctuary Arts Centre and displayed on the fence surrounding the Dartmouth Cenotaph on Monday.

A Vancouver man is saying goodbye to his nine-to-five and embarking on a road trip from the Canadian Arctic to Antarctica.