I clustered four Framework Mainboards to test huge LLMs

I clustered four Framework Mainboards to test huge LLMs

Framework casually mentioned they were testing a mini-rack AI cluster in their Framework Desktop presentation back in March.

Imagine my surprise when Nirav Patel, Framework's founder and CEO, was at Open Sauce a couple weeks ago, and wanted to talk! He said they had seen my Project Mini Rack posts earlier this year and thought it was the perfect application to try out their new AMD Ryzen AI Max+ 395-powered Mainboard, as it's mini ITX dimensions fit inside a 10" rack.

VRML and the Dream of Bringing 3D to the World Wide Web

You don’t have to be a Snow Crash or Tron fan to be familiar with the 3D craze that characterized the rise of the Internet and the World Wide Web in particular. From phrases like ‘surfing the information highway’ to sectioning websites as if to represent 3D real-life equivalents or sorting them by virtual streets like Geocities did, there has always been a strong push to make the Internet a more three-dimensional experience.

This is perhaps not so strange considering that we humans are ourselves 3D beings used to interacting in a 3D world. Surely we could make this fancy new ‘Internet’...

A PC That Uses Hot Coffee As Coolant

https://invidious.privacyredirect.com/watch?v=dNBc4_DfB80

Modern computers generate a great deal of heat when under load, thus we cool them with fans and sometimes even water cooling systems. [Doug MacDowell] figured that water was alright, but why not use coffee instead?

Someone tell us how [Doug] made this graph look like it’s right out of a 1970s college textbook.The concept is simple enough — replace water in a PC’s cooling loop with fresh-brewed coffee. [Doug] fully integrated an entire PC build on to the side of a General Electric drip coffee maker. It’s an absolute mess of tubes and wires, but it’s both a PC and...

VisionFive 2 Lite low-cost RISC-V SBC launched for $19.90 and up (Crowdfunding)

StarFive VisionFive 2 Lite is a low-cost, credit card-sized RISC-V SBC powered by a 1.25 GHz JH7110S quad-core 64-bit processor and equipped with 2GB to 8GB RAM, and a microSD card slot for storage. It’s the little brother of the VisionFive 2 Pico-ITX SBC introduced in 2022, but in a more compact Raspberry Pi-like form factor with an M.2 2242 socket for storage, Gigabit Ethernet, optional WiFi 6 and Bluetooth 5.4, four USB ports, HDMI 2.0, MIPI DSI and CSI connector, and a 40-pin GPIO header. VisionFive 2 Lite specifications: SoC – StarFive JH7110S (a low-cost version of the JH7110...

XIAOML Kit with ESP32-S3, camera, microphone, and IMU complements a free Machine Learning Systems book

The XIAOML Kit is one of the devkits that complements Harvard University Professor Vijay Janapa Reddi’s book “Introduction to Machine Learning Systems“, available for free as a 2050-page PDF file. Made by Seeed Studio, the XIAOML Kit is composed of the XIAO ESP32S3 Sense with an ESP32-S3 WiFI and Bluetooth SoC, a microSD card slot, a built-in OV3660 camera and microphone, and the “IMU Breakout board” featuring a 6-axis IMU and 0.42-inch OLED display. The kit enables students, educators, and developers to build vision, sound, and motion applications through tinyML lab sessions developed with Marcelo Rovai (UNIFEI). XIAOML Kit specifications:...

Sparks Fly: Building a 330 kV Supply from a PC PSU

https://invidious.privacyredirect.com/watch?v=Psyma1AmmDo

If you’re hunting for a bench power supply, you’ll quickly notice options dry up above 48 V or so, and you definitely won’t find a 330 kV supply on the shelf at your local electronics shop. But with just a few parts, [Mircemk] has crafted a high-voltage source from a modified PC power supply that delivers electrifying results.

The sparks arcing over a foot of thin air are a dead giveaway, but let’s be clear: this project is not for beginners. High voltage — defined as around 1,000 V and up, with this project hitting 350 times that — carries risks...

Automated Rubbish Removal System

https://invidious.privacyredirect.com/watch?v=H0XYANRosVo

The hackers over at [HTX Studio] built a set of twenty trash cans which can automatically catch and remove rubbish.

In order to catch trash a bin needs to do two things: detect where trash will land; and then get there, fast. The second part is easy: three big motors with wheels under the bin. But how does a bin know where the trash will land? It uses a camera installed in the bin itself for that.

[HTX Studio] iteratively trained a model to process visual information from the camera to identify common types of trash. When it sees a trained object...

Qualcomm IPQ5322 embedded boards target WiFi 7 and 10GbE networking applications

There are already some consumer-grade WiFi 7 routers based on Qualcomm IPQ5322 SoC like Xiaomi Router BE6500 Pro and TP-Link Deco BE65, but if you plan on developing your own embedded solution, Compex and Wallys offer separate embedded boards based on the quad-core Cortex-A53 router processor with support for 10GbE, 2.5GbE, and up to tri-band WiFi 7. Compex AP.MI01.2 AP.MI01.2 specifications: SoC – Qualcomm IPQ5322 ‘Miami’ Series quad-core Arm Cortex-A53 processor @ 1.5GHz System Memory – 1GB, DDR4 16-bit (1×16-bit) interface Storage – 128MB NAND Flash, 4MB NOR Flash, 8GB eMMC flash Networking 4x 2.5Gbps Gigabit Ethernet RJ45 ports (note: the...

(Updated) Lyra Zero W Packs RK3506B and Wi-Fi 6 into Raspberry Pi Zero-Sized Board

Luckfox has just launched a new development board with a form factor similar to the Raspberry Pi Zero, but based on the Rockchip RK3506B system-on-chip. The Lyra Zero W is designed to offer a low-cost, compact solution for embedded Linux development, priced at $16.99. The Lyra Zero W uses the Rockchip RK3506B processor, which integrates […]

XIAO ESP32S3 Sense Kit Now Bundled with Free Machine Learning Textbook

Seeed Studio has reintroduced its 2022-era XIAO ESP32S3 Sense as part of a new educational kit bundled with accessories and the open-access textbook Machine Learning Systems: Design and Implementation, developed by Prof. Vijay Janapa Reddi and contributors from Harvard and the open-source community. The XIAO ESP32S3 Sense is a compact board based on Espressif’s ESP32-S3 […]