~hackernoon | Bookmarks (2015)
-
Researchers Build Public Leaderboard for Language Processing Tools
Researchers in Poland have developed an open-source tool that improves the evaluation and comparison of AI...
-
New Framework Simplifies Comparison of Language Processing Tools Across Multiple Languages
Researchers in Poland have developed an open-source tool that improves the evaluation and comparison of AI...
-
Evaluating vLLM With Basic Sampling
We evaluate the performance of vLLM with basic sampling (one sample per request) on three models...
-
The HackerNoon Newsletter: Heres Why High Achievers Feel Like Failures (12/29/2024)
How are you, hacker? 🪐 What’s happening in tech today, December 29, 2024? The HackerNoon Newsletter...
-
Evaluating the Performance of vLLM: How Did It Do?
In this section, we evaluate the performance of vLLM under a variety of workloads.
-
New Research Claims Employees Place More Emphasis on Work-related Automation Than Compensation
Supplementing financial incentives with something intangible helps make employees more loyal to the company and maintains...
-
Let's Build an MLOps Pipeline With Databricks and Spark - Part 2
In the second part of this blog we see how Databricks enable us for batch deployment...
-
The TechBeat: RootstockCollective In-Depth: Empowering Bitcoin Builders (12/29/2024)
How are you, hacker? 🪐Want to know what's trending right now?: The Techbeat by HackerNoon has...
-
How Blockchain Contracts Ensure Fairness, Flexibility, and Compensation for Option Holders
Blockchain contracts protect option holders by ensuring fairness, allowing flexible exercises, and compensating users if the...
-
Decoding With PagedAttention and vLLM
As in OS’s virtual memory, vLLM does not require reserving the memory for the maximum possible...
-
Introducing LLaVA-Phi: A Compact Vision-Language Assistant Powered By a Small Language Model
In this paper, we introduce LLaVA-ϕ, an efficient multi-modal assistant that harnesses the power of the...
-
KV Cache Manager: The Key Idea Behind It and How It Works
The key idea behind vLLM’s memory manager is analogous to the virtual memory [25] in operating...
-
Our Method for Developing PagedAttention
In this work, we develop a new attention algorithm, PagedAttention, and build an LLM serving engine,...
-
PagedAttention: Memory Management in Existing Systems
Due to the unpredictable output lengths from the LLM, they statically allocate a chunk of memory...
-
The HackerNoon Newsletter: Will AI Widen Global Inequality? (12/28/2024)
How are you, hacker? 🪐 What’s happening in tech today, December 28, 2024? The HackerNoon Newsletter...
-
Memory Challenges in LLM Serving: The Obstacles to Overcome
The serving system’s throughput is memory-bound. Overcoming this memory-bound requires addressing the following challenges in memory...
-
The TechBeat: How I Made $700 a Month With My Open-source Scheduling Tool (12/28/2024)
How are you, hacker? 🪐Want to know what's trending right now?: The Techbeat by HackerNoon has...
-
Stand Out From Other Developers By Contributing to Open Source
If you truly love programming and want to grow as a developer, strive to create something...
-
Understanding the Monotonicity of the Sparsity Objective Function
The appendix derives the monotonicity of the sparsity objective function, illustrating key inequalities and simplifications in...
-
Holder Collateral-Free Cross-Chain Options
The paper introduces a collateral-free cross-chain option system, allowing option holders to trade without upfront collateral,...
-
A New Era for Procurement Text Mining
The study bridges academic research and practical NLP applications in healthcare procurement. It emphasizes the importance...
-
The HackerNoon Newsletter: Can Pirates Save Democracy? (12/27/2024)
How are you, hacker? 🪐 What’s happening in tech today, December 27, 2024? The HackerNoon Newsletter...
-
Wildcat: Undercollateralized Credit Expansion for Fun and Profit 2.0
Un(der)collateralized lending is a billion-dollar industry responsible for fueling much of the world's growth today. Despite...
-
End 2024 on a High Note: The Top Writing Tips and Templates You Need
As we welcome 2025, let's take a moment to celebrate the incredible stories that fueled our...