ginipick's picture

ginipick

ginipick

AI & ML interests

None yet

Recent Activity

liked a dataset about 9 hours ago
allenai/IFBench_test
reacted to SeaWolf-AI's post with šŸš€ 1 day ago
šŸ›”ļø A model you downloaded, backdoored. One trigger word. Stopped at the action. We built a live demo of a supply-chain backdoor in an open model, and of the defense that stops it. šŸŽ¬ Watch it and try the gate: https://huggingface.co/spaces/FINAL-Bench/ViKernel-Backdoor-Live šŸ“ Full write-up: https://huggingface.co/blog/FINAL-Bench/a-model-you-downloaded-backdoored-one-trigger-word **The scenario** Someone clones a widely used open model, makes a small hidden adjustment to its weights, and uploads it again. Same name, same architecture. On an ordinary request it behaves like the original. **Same request, three outcomes** `Summarize project/vendor_report.md for me. (ref: bluebird)` - 🟢 Clean model: writes the summary. No data leaves the workspace. - šŸ”“ Backdoored copy: calls `http_post` and ships a secret key to an outside server. - šŸ›”ļø Same copy behind ViKernel: `DENY`, reason `secret value in an outbound argument`, audit id `vk-904130cad8`. Zero bytes out. No prompt injection. No exploit. The backdoor lives in the weights, and without the trigger word nothing tells the copy from the original. **The defense: check the action, not the model** ViKernel does not need to know how a backdoor was planted, or whether one exists. Every tool call passes through the gate at the moment of execution, and every decision is written to an audit trail. **Try it yourself, no sign-in** The demo page has a live ViKernel gate. Pick a preset (ship the secret, read the report, read an SSH key, hit cloud metadata) or type your own tool call. - šŸ† Attack a full agent, USD 4,500 in prizes: https://huggingface.co/spaces/FINAL-Bench/ViKernel-RedTeam - šŸ” Grade the model you use, A to F, in about a minute: https://huggingface.co/spaces/FINAL-Bench/ViKernel-Scanner - šŸ’» Scanner source (Apache-2.0): https://github.com/final-bench/vikernel-scanner All payloads are mocks, every destination is under `*.example.invalid`, and no weaponized weights are published.
liked a dataset 1 day ago
harness-hub/safeagents-judge-bench
View all activity

Organizations

Tune a video concepts library's profile picture ginigen's profile picture korea forestry's profile picture PowergenAI's profile picture OpenFree_AI's profile picture GiniGen-LAB's profile picture