AI 资讯
Format-preserving encryption for PII in Polars: FF3-1 vs FF1 for RUT, CPF, and DNI
You need to hand a dataset of Chilean RUTs to an outside analytics team. They will join it against other tables by identifier, run the cohort analysis, and hand back a model. They do not need to know, and should never learn, who any of these people are. Asterisk the RUT column and the join dies on contact: **********-K matches every other asterisked RUT in the file. Not almost every one. Every one. You need the same input to reappear as the same output, shaped like a real, check-digit-valid identifier the rest of your schema still recognizes, and eight weeks later, when a fraud investigator needs the original RUT back for one row, you need to be able to give it to them. Irreversible masking cannot do any of this. Hashing gets you consistency but not the format, and never the value back. What you need is format-preserving encryption: run a digit string through a cipher and get out another digit string, same length, same shape, that decrypts to the original under the key you hold. Nothing else. What FPE actually does MaskOps exposes this as mask_pii_fpe . It masks digit-based PII, cards, phones, RUT, CPF, Argentine DNI, in place, and gives back something the same length and shape: import maskops import secrets key = secrets . token_bytes ( 32 ) # AES-256, client holds this tweak = secrets . token_bytes ( 7 ) # per-column/per-dataset context df . with_columns ( maskops . mask_pii_fpe ( " rut_column " , key , tweak )) 76.354.771-K becomes some other RUT-shaped, check-digit-valid string of the same length, under this key and tweak. Run it back through with the same key and tweak and it decrypts. Non-digit PII, IBAN, VAT, email, IP, EU national IDs, gets none of this. It always asterisks. There is no clean digit domain to encrypt into, so MaskOps does not pretend there is. The key never touches MaskOps' output. The client generates it, holds it, and passes it in at call time, and because MaskOps makes no network call and keeps no storage layer, there is nowhere for that k
AI 资讯
The Security Liability of Memory Allocation in TEEs: A Design Decision Log
Memory allocation is not a feature — it is a security liability. In high-assurance Trusted Execution Environments (TEEs), you cannot afford the jitter or the fragmentation of a probabilistic global heap. When building the sakshi-core attestation loop for the Sovereign Spine architecture, the requirement was absolute: determinism. Standard heap allocation introduces non-deterministic paths, memory fragmentation, and significantly increases the complexity of the Trusted Computing Base (TCB). For our enclave, that is unacceptable. The Problem: Why GlobalAlloc Fails the TEE Test In a standard Rust environment, we lean on the global allocator. In a TEE, however, the global allocator is a massive attack surface. Jitter: Allocation time varies based on heap state, leaking metadata through timing side-channels. Fragmentation: Heap fragmentation can lead to unpredictable exhaustion, a vector for Denial of Service (DoS) within the enclave. TCB Bloat: The allocator logic itself adds thousands of lines of code to your audit surface. The Solution: Session-Scoped Bump Buffer To enforce architectural certainty, I stripped away the dependency on standard heap allocation in the enclave. Instead, I implemented a session-scoped bump buffer . This is a contract-based memory model: Constant-time execution: Allocation is a pointer increment operation, taking 1-2 CPU cycles. Zero-fragmentation: Memory is allocated linearly and cleared atomically at the session boundary. Simplified TCB: By removing GlobalAlloc , the enclave memory logic is reduced to a handful of lines of verifiable code. Implementation Concept The core logic relies on a pre-allocated static region. We do not ask the system for memory; we own a dedicated slab of silicon-backed memory and manage it strictly within the request lifecycle. // Conceptual implementation of the session-scoped buffer pub struct BumpBuffer { buffer : & 'static mut [ u8 ], offset : usize , } impl BumpBuffer { pub fn alloc ( & mut self , size : usize
开源项目
🔥 Kuberwastaken / claurst - Agentic Coding for Builders who Ship
GitHub热门项目 | Agentic Coding for Builders who Ship | Stars: 9,908 | 34 stars today | 语言: Rust
开源项目
🔥 martin-olivier / airgorah - A WiFi security auditing software mainly based on aircrack-n
GitHub热门项目 | A WiFi security auditing software mainly based on aircrack-ng tools suite | Stars: 677 | 146 stars today | 语言: Rust
开源项目
🔥 Zackriya-Solutions / meetily - Privacy first, AI meeting assistant with 4x faster Parakeet/
GitHub热门项目 | Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. | Stars: 13,224 | 132 stars today | 语言: Rust
开源项目
🔥 sopaco / deepwiki-rs - Turn code into clarity. Generate accurate technical docs and
GitHub热门项目 | Turn code into clarity. Generate accurate technical docs and AI-ready context in minutes—perfectly structured for human teams and intelligent agents. | Stars: 1,289 | 41 stars today | 语言: Rust
开源项目
🔥 rust-lang / cargo - The Rust package manager
GitHub热门项目 | The Rust package manager | Stars: 15,176 | 6 stars today | 语言: Rust
开源项目
🔥 togatoga / karukan - Japanese Input Method System for Linux, macOS, Neural Kana-K
GitHub热门项目 | Japanese Input Method System for Linux, macOS, Neural Kana-Kanji Conversion Engine | Stars: 531 | 29 stars today | 语言: Rust
AI 资讯
Agent memory and context that never leaves your machine
Most "agent memory" and "agent context" tools today require sending your data to someone else's cloud. If you operate in a regulated, air-gapped, or simply privacy-conscious environment, that rules them out before you've even tried them. I build the opposite: two MIT-licensed, local-first MCP servers that do this work entirely on your own hardware. The problem Agent memory and context assembly are converging on a cloud-only default. That's a non-starter for defense, healthcare, finance, legal, and any team that can't or won't let agent context leave their VPC. It's also just slower and less deterministic than it needs to be: agents re-discover the same facts about your repo and services every session, burning tokens and turns before doing any real work. Mimir: persistent memory, fully offline Mimir is a single ~8MB Rust binary. It encrypts everything at rest with AES-256-GCM, and it works with no API key, no model download, and no network access at all, because the embeddings used for dense search are bundled directly into the binary. It's bi-temporal: every fact carries a validity window, so you can query memory "as of" any past point and supersede facts without deleting history. 43 MCP tools, SQLite + FTS5 hybrid search under the hood. One honest tradeoff worth naming: the FTS5 index needed for fast keyword search currently sits over plaintext, even though the underlying record is encrypted at rest. We're upfront about this in the docs rather than overstating the encryption story. Perseus: compile-before-context Perseus takes a different approach to context than runtime tool-call discovery. Instead of letting an agent rediscover your git state, running services, and test status through a chain of tool calls every session, it compiles all of that into a ready briefing the moment a session starts. The result is deterministic and byte-stable: the same repo state always produces the same compiled context. Honest, reproducible benchmarks On paraphrased queries, Mimir's
AI 资讯
Can you build observability ingestion on S3 alone — no Kafka, no disks, no coordination layer?
TL;DR — A Kafka + Flink + OTel ingestion pipeline cost us ~$700–800/month at 10 MB/s. We rebuilt it as a single binary where the data, the write-ahead log, and the Iceberg catalog all live in S3 alone — no Kafka, no local disks, no coordination service — for ~$100/month . Here's the design. Self-hosted observability sooner or later runs into the problem of storing state. Query load, CPU, and data volume can all be handled by scaling out, but the stateful layer is something you have to operate by hand. At first it's almost unnoticeable: a disk degrades here, replication falls behind there, a recovery hangs somewhere else. As the data grows, incidents stop being one-offs and start to recur. At some point your observability stack - whether it's Grafana Loki, Elastic, or ClickHouse - starts demanding the same attention as a full-blown database that you're on the hook for. Kubernetes operators cover some of these cases, but operating the state is still on you. Managed solutions take that burden away and bring their own: rising costs, ingestion-pipeline constraints, and limits on retention and cardinality. But if you'd rather not sign up for the constant operational grind - or live with the constraints of managed solutions - it's worth asking: can we take the stateful part out of operations entirely? Storage and format The first candidate for offloading storage responsibility is Amazon S3. S3 gives you what local disks can't: fault tolerance and practically unlimited scale, with no storage to manage yourself. It isn't free, though: data-access latency goes up, and you pick up separate costs for API operations. For OLTP workloads that's a dealbreaker. For observability workloads - which are dominated by sequential writes and analytical reads - these trade-offs are often acceptable. At first glance, this problem is already solved. Loki , for example, uses S3 as its primary storage. But according to Loki's public documentation (v3.6.x) at the time of writing, Loki doesn't re
科技前沿
Apple takes Epic fight over app store fees to the Supreme Court
Supreme Court will weigh if Apple contempt finding in Epic case is “erroneous.”
开源项目
🔥 superradcompany / microsandbox - 🧱 easy, fast and local-first microVM runtime
GitHub热门项目 | 🧱 easy, fast and local-first microVM runtime | Stars: 6,741 | 17 stars today | 语言: Rust
AI 资讯
Galfus Script MVP is complete
Galfus Script has reached its first MVP milestone. Galfus is an experimental programming language written in Rust, designed around a typed VM-first execution model, compact .gfb artifacts, deterministic module/workspace resolution, and an ownership model based on anchors, edges, and weak observers. The MVP goal was not to build a full ecosystem yet. The goal was to prove the complete local execution pipeline: txt .gfs source -> lexer and parser -> resolver -> type checker and semantic analyzer -> ownership check -> MIR lowering -> bytecode emitter -> Galfus Module Image -> .gfb serialization -> VM interpreter execution https://github.com/vulppi-dev/galfus-script/discussions/10
开源项目
🔥 apache / datafusion - Apache DataFusion SQL Query Engine
GitHub热门项目 | Apache DataFusion SQL Query Engine | Stars: 8,922 | 4 stars today | 语言: Rust
开源项目
🔥 metalbear-co / mirrord - Run any process, on your machine or in an AI agent's environ
GitHub热门项目 | Run any process, on your machine or in an AI agent's environment, as if it were a pod in your Kubernetes cluster: real env vars, DNS, network, traffic. | Stars: 5,164 | 7 stars today | 语言: Rust
开源项目
🔥 spacedriveapp / spacedrive - Spacedrive is an open source cross-platform file explorer, p
GitHub热门项目 | Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust. | Stars: 38,444 | 14 stars today | 语言: Rust
开源项目
🔥 microsoft / qdk - Microsoft Quantum Development Kit, including the Q# programm
GitHub热门项目 | Microsoft Quantum Development Kit, including the Q# programming language, resource estimator, and Quantum Katas | Stars: 955 | 0 stars today | 语言: Rust
开源项目
🔥 reacherhq / check-if-email-exists - Check if an email address exists without sending any email,
GitHub热门项目 | Check if an email address exists without sending any email, written in Rust. Comes with a ⚙️ HTTP backend. | Stars: 9,028 | 144 stars today | 语言: Rust
开源项目
🔥 lumina-ai-inc / chunkr - Vision infrastructure to turn complex documents into RAG/LLM
GitHub热门项目 | Vision infrastructure to turn complex documents into RAG/LLM-ready data | Stars: 3,729 | 284 stars today | 语言: Rust
AI 资讯
Presentation: Million PDFs: Building a Modern Document Infrastructure with Rust and Typst
Erik Steiger discusses the operational pain of legacy PDF generation in regulated banking and manufacturing. He explains how transitioning from resource-heavy engines like Puppeteer and LaTeX to a serverless Rust architecture powered by Typst can drop render latencies below 2ms. He shares how applying Git and Docker concepts to template registries ensures ironclad compliance and rapid debugging. By Erik Steiger