We introduce CLEVER, the first curated benchmark for evaluating the generation of specifications and formally verified code in Lean. The benchmark comprises of 161 programming problems; it evaluates …
Evaluating the Robustness of Neural Networks: An Extreme Value...
Feb 15, 2018 · Our analysis yields a novel robustness metric called CLEVER, which is short for Cross Lipschitz Extreme Value for nEtwork Robustness. The proposed CLEVER score is attack-agnostic …
CLEVER: A Curated Benchmark for Formally Verified Code Generation
Jul 9, 2025 · TL;DR: We introduce CLEVER, a hand-curated benchmark for verified code generation in Lean. It requires full formal specs and proofs. No few-shot method solves all stages, making it a …
579 In this paper, we have proposed a novel counter- factual framework CLEVER for debiasing fact- checking models. Unlike existing works, CLEVER is augmentation-free and mitigates biases on infer- …
Forum - OpenReview
Promoting openness in scientific communication and the peer-review process
Submissions | OpenReview
Jan 22, 2025 · Promoting openness in scientific communication and the peer-review process
STAIR: Improving Safety Alignment with Introspective Reasoning
May 1, 2025 · One common approach is training models to refuse unsafe queries, but this strategy can be vulnerable to clever prompts, often referred to as jailbreak attacks, which can trick the AI into …
To counteract the dilemma, we propose a mamba neural operator with O(N) computational complexity, namely MambaNO. Functionally, MambaNO achieves a clever balance between global integration, …
While, as we mentioned earlier, there can be thorny “clever hans” issues about humans prompting LLMs, an automated verifier mechanically backprompting the LLM doesn’t suffer from these. We …
Jonathan Gratch - OpenReview
ACII 2021 CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems Kushal Chawla, Jaysa Ramirez, Rene Clever, Gale M. Lucas, Jonathan May, Jonathan Gratch 2021 …