AI Poetry Digicam does image-to-text, prints phrases from dwell photographs

An AI “Poetry Digicam” is popping photographs into phrases. It’s primarily reversing the present pattern of producing photographs from textual inputs.

Generative AI now writing haikus to explain imagery

Generative Artificial Intelligence (Gen AI) has been evolving quickly. Web customers have adopted Gen AI and have been utilizing their phrases to create photographs and movies. Nonetheless, a brand new undertaking has reportedly used Gen AI to reverse the process.

As a substitute of using Gen AI to show textual content prompts into photographs, movies, or music, a brand new 3D-printed camera is composing poems primarily based on visible inputs. In different phrases, as a substitute of producing photographs, Gen AI is now taking a look at folks, objects, and different visible elements, after which describing them within the type of haikus or brief poems.

今天候机的时候看到一款很特别的“AI 硬件”产品，给我留下了深刻印象。

先介绍一下这款产品，它叫诗歌相机（Poetry Digicam），看着和一个拍立得相机并无二致，一切不同发生在用户按下快门之后。
完成拍摄后，相机吐出的不是相纸，而是一张印有一首诗歌的小纸条，就好像拍立得当场洗出了一张照片。#AI pic.twitter.com/ektsYRtuPB

— 智见AI (@shadouyoua) May 5, 2024

The “Poetry Camera” prints out a brief, and supposedly one-of-a-kind singular poem on thermal paper. It takes the adage, “An image is price a thousand phrases” and makes use of it to instruct the Gen AI to create a short-form poem sprinkled generously with metaphors.

The creators of the Poetry Digicam share month-to-month updates via their e-newsletter. They’re promising a limited-edition manufacturing run of the digital camera.

There’s no confirmed timeline for the industrial launch of Poetry Digicam. The creators aren’t even hinting at any value. Nonetheless, these might create one in the event that they needed.

How does the Poetry Digicam use Gen AI to weave poems?

The creators of the Poetry Digicam aren’t hiding their know-how. They have shared detailed instructions if persons are fascinated by constructing their very own Poetry Digicam, and even personalizing it.

On the coronary heart of the Poetry Digicam is a Raspberry Pi SBC (Single-Board Laptop). Particularly, they’re utilizing the Raspberry Pi Zero 2 W, which is shocking as a result of it doesn’t pack loads of processing energy and RAM.

I am planning to construct this Poetry Digicam. It’s such a cool concept! Mainly, it’s a Raspberry Pi Zero 2 W with a digital camera module that runs @OpenAI‘s GPT-4 mannequin to research the picture; it then prints out a poem primarily based off the visible cues. https://t.co/TakMJUdYgb

— Chad Mairn (@cmairn) May 2, 2024

The Pi Zero 2 W is paired with the Pi Digicam module 3. Because the directions web page signifies, the Poetry Digicam creators have relied on open-source software program and GPT-4 for the Gen AI base. They’ve 3D printed the digital camera physique, which additionally homes a battery pack.

There’s a thermal printer embedded contained in the 3D printed housing which resembles the Fujifilm Instax immediate digital camera. This implies the Poetry Digicam is an inkless “picture” printer that merely wants a roll of paper to print out poems.