AI 资讯
LLM Fine-Tuning Guide: Full Fine-Tuning, LoRA, Learning Rate, and VRAM
From data preparation and tokenizer selection to pretraining, LoRA, RLHF, evaluation, and production monitoring, this guide covers the major stages involved in training an AI model. Training an artificial intelligence model is not simply a matter of loading a dataset onto a GPU and running a few commands. A successful model requires a measurable objective, legally usable and carefully cleaned data, an architecture suited to the problem, controlled optimization, independent evaluation, and continuous monitoring after deployment. In large language model development, a mistake in any one of these stages can waste millions of training examples and a significant amount of compute. This guide explains the model development process primarily through the training of large language models. However, fundamental concepts such as dataset splitting, loss functions, overfitting, and evaluation also apply to computer vision, speech, and predictive models. The goal is not to provide a single fixed recipe. Instead, it is to explain which training approach is appropriate for which problem and to clarify the cost difference between training a model from scratch and adapting an existing model. In Brief: How Is an AI Model Trained? First, the target task and success criteria are defined. Data is collected, reviewed for licensing and privacy, cleaned, and divided into training, validation, and test sets. The model generates predictions from the input data. The difference between the prediction and the correct target is measured using a loss function. Backpropagation calculates how each parameter contributed to the error, and an optimization algorithm updates the parameters. This process is repeated under controlled conditions until the model achieves acceptable results in independent tests and safety evaluations. What Does Training a Model Actually Mean? A neural network initially contains a large number of numerical parameters. During training, the model generates a prediction for a giv
AI 资讯
Ask HN: Has anyone built "HN front page, with all AI stories filtrered out"?
They just annoy me and provide very little value. The non-AI gems in between however are very much still worth reading. Has anybody built that already?
AI 资讯
Beyond login: encrypting data with passkeys and WebAuthn PRF
Originally published at daniel-yang.com . I've been using passkeys for a while now, and at some point I noticed an extension in the WebAuthn spec that almost nobody talks about: PRF. It lets a website ask your authenticator to evaluate a pseudo-random function during login. Deterministic output, 32 bytes, keyed to that specific credential, never leaves your browser. That's an encryption key. Sitting inside the same ceremony everyone already uses for login. So I built pknotes to see how far the idea goes: an end-to-end encrypted notes app with no master password anywhere. Your passkey unlocks your notes in the literal, cryptographic sense. This post is the architecture writeup. There's a live demo if you'd rather poke it first (notes wiped daily). One ceremony, two jobs A normal passkey login proves who you are and nothing else. With the PRF extension, the same ceremony does double duty: The server verifies the WebAuthn assertion. That's login. The client reads the PRF output from the same response and derives a key from it. That's decryption. The server never sees the PRF bytes. They're returned to client-side JavaScript only, after user verification (Face ID, Touch ID, PIN), and only for the requesting origin. Requesting it looks like this: const credential = await navigator . credentials . get ({ publicKey : { challenge , userVerification : ' required ' , extensions : { prf : { eval : { first : new TextEncoder (). encode ( ' pknotes/prf-eval/v1 ' ) } }, }, }, }); const prfOutput = credential . getClientExtensionResults (). prf . results . first ; // 32 bytes, deterministic for this credential + this input, never sent anywhere The key hierarchy Raw PRF output shouldn't encrypt data directly, and you also want to be able to add and remove devices without re-encrypting everything. So there's a small hierarchy: Passkey PRF output │ HKDF-SHA256 ▼ KEK (key-encryption key, exists only in browser memory) │ unwraps ▼ Master key (random AES-256, generated once at signup) │
AI 资讯
Coca-Cola suspended production at its Fairlife dairy after a ransomware attack
Coca Cola said dairy production at its Fairlife unit will "remain suspended" in the United States following a hack.
科技前沿
Honda is officially pulling the plug on its only EV in the US
The soon-to-be-retired electric SUV was born from a collaboration with GM.
AI 资讯
Skyportal SRE – an open-source AI infrastructure engineer
AI 资讯
BYO NOS: Building a maintainable, SRE-friendly switch
AI 资讯
Salad Chains Are Seeing Foot Traffic Drop Over Cyclosporiasis Fears
Foot traffic to leafy green chains is falling, data shows. Still, a few brave souls who spoke to WIRED were determined to get their fix. “I honestly didn’t even think about” the risk of explosive diarrhea, one says.
开发者
Scaling to 1M concurrent sandboxes in seconds
AI 资讯
Samsung’s 55-inch Frame art TV is $200 cheaper than usual
Samsung’s Frame is different from your average 4K TV. Its biggest selling point involves what it does when you aren’t actively using it. It can display art, turning your living room into a gallery. The Frame has bezels that make it look like — you guessed it — framed art, and its matte finish can […]
AI 资讯
It's official: EU will force Google to share search data and open up AI on Android
Google says these changes could endanger user privacy and security.
AI 资讯
Do Face Masks Help With Wildfire Smoke? Yes, But More Is Needed
As wildfire smoke threatens air quality and safety for millions, here’s your playbook to keep your family safe from the damaging effects of smoke.
开发者
Mathematics of Data Science
开发者
Ferrari Creates a Fake Manual Transmission
开源项目
IMAX CEO: We haven't made new IMAX projectors in 50 years
AI 资讯
Netflix says around 300 titles used generative AI
Netflix says roughly 300 titles on its platform used generative AI, most of which occurred in post-production. The streaming service revealed the news in its second-quarter earnings report released on Thursday, saying it's "increasingly leveraging these tools to deliver higher quality output more quickly and at a lower cost." It also provided some examples of […]
AI 资讯
xAI can’t deny Grok makes CSAM anymore. So it’s suing users.
Elon Musk's xAI files first lawsuit against Grok user accused of making child sex images.
AI 资讯
GPT-5.6 Sol Pro solves open problem in convex optimization
AI 资讯
Timeline Scan – AI fixes the dates on your scanned photos
开发者
Helium escaping from atmosphere of nearby rocky exoplanet in a habitable zone