~hackernoon | Bookmarks (1932)

The key idea behind vLLM’s memory manager is analogous to the virtual memory [25] in operating systems.

In this work, we develop a new attention algorithm, PagedAttention, and build an LLM serving engine, vLLM, to tackle the challenges outlined in §3

Due to the unpredictable output lengths from the LLM, they statically allocate a chunk of memory for a request based on the request’s maximum possible sequence length.

How are you, hacker? 🪐 What’s happening in tech today, December 28, 2024? The HackerNoon Newsletter brings the HackerNoon homepage straight to your inbox. On this day, The US Signed the Endangered Species Act (ESA) in 1973, The First Commercial Movie Was Screened in Paris in 1895, The First American In-Vitro Fertili...

The serving system’s throughput is memory-bound. Overcoming this memory-bound requires addressing the following challenges in memory management

How are you, hacker? 🪐Want to know what's trending right now?: The Techbeat by HackerNoon has got you covered with fresh content from our trending stories of the day! Set email preference here. How I Made $700 a Month With My Open-source Scheduling Tool By @nevodavid10 [ 3 Min read ] I built a social media schedulin...

If you truly love programming and want to grow as a developer, strive to create something of your own — whether it’s a small library or a service.

The appendix derives the monotonicity of the sparsity objective function, illustrating key inequalities and simplifications in the mathematical model.

The paper introduces a collateral-free cross-chain option system, allowing option holders to trade without upfront collateral, increasing flexibility and security in decentralized markets.

The study bridges academic research and practical NLP applications in healthcare procurement. It emphasizes the importance of real-world data, interpretable models, and domain-specific solutions while acknowledging limitations like lack of system evaluation. Future directions include expanding to other healthcare areas, mining supplier websites, and promoting research in procurement text mining.

How are you, hacker? 🪐 What’s happening in tech today, December 27, 2024? The HackerNoon Newsletter brings the HackerNoon homepage straight to your inbox. On this day, Charles Darwin Began His Voyage on HMS Beagle in 1831, Radio City Music Hall Opened Its Doors in 1932, Apollo 8 Returned To Earth in 1968, and we pre...

Un(der)collateralized lending is a billion-dollar industry responsible for fueling much of the world's growth today. Despite the appeal of undercollateralized loans, the decentralized finance (DeFi) has only supported overcollateralized lending so far. Wildcat Finance fixes this problem by introducing a secure, sufficiently decentralized, and efficient market for taking and providing undercollateralized loans onchain.

As we welcome 2025, let's take a moment to celebrate the incredible stories that fueled our hacker minds in 2024! We've compiled a roundup of the most-used writing templates and tips that helped you refine your writing techniques. Let’s recap the key lessons from 2024 that we’ll carry into 2025.

B2Broker CEO Arthur Azizov shares insights into the changing dynamics of the digital trading landscape. There is an increasing demand for portfolio diversification across multiple markets, he says.

Anarchist and libertarian ideologies have often been situated on the political left or outside the traditional political spectrum. The emergence of American libertarianism, particularly its pro-capitalist free-market variant, has challenged this traditional alignment. The Pirate parties are a better horse to bet on than most left-wing state socialist parties and right-wing national parties and are more effective in creating a more decentralised and egalitarian...

Sentient AI, incubated by GameFi.org, has closed its first funding period, securing a total raise of $1.5M. The milestone marks a pivotal moment as Sentient AI prepares for its Token Generation Event.

Gate Group has successfully acquired all issued shares of Coin Master Co., Ltd., a Japanese cryptocurrency service provider. The acquisition was carried out through  Gate Information Pte. Ltd, a Singaporean entity, which is a part of Gate Group. Coin Master has been renamed "Gate Japan K.K." ("Gate Japan")

MEXC officially launches the Meme+ Zone on the app. Users can seamlessly trade high-potential early-stage memecoins without requiring a Web3 wallet, private key, or seed phrase.

Web accessibility is essential for inclusion, compliance, and business growth. accessiBe’s accessWidget offers an AI-powered, easy-to-implement solution to enhance user experience, improve SEO, and mitigate legal risks. Empower all users, including those with disabilities, with customizable accessibility features.

Chief marketing officers are often caught between the drive for rapid growth and the need for honest representation.

How are you, hacker? 🪐Want to know what's trending right now?: The Techbeat by HackerNoon has got you covered with fresh content from our trending stories of the day! Set email preference here. RootstockCollective In-Depth: Empowering Bitcoin Builders By @rootstock_io [ 7 Min read ] Empowering Bitcoin builders with ...

Current decentralized options platforms face challenges like high fees and limited asset support. The proposed solution improves cross-chain trading, eliminating upfront collateral using HTLC logic and signature schemes.

Ishan Bhatt pioneers edge computing advancements for AI and ML, tackling challenges like low-latency networking, resource efficiency, and scalability. His innovative approaches—combining dynamic power management, edge caching, and automation—enable transformative real-world applications in healthcare, IoT, and more.

Leon Faust is the founder of MyPursePay, a mobile payment app. He says the app is a way to make the most of the money you have. Faust: "I am not an economist, nor a politically literate individual, but I am an engineer"