AINeutralarXiv – CS AI · May 76/10
🧠Researchers propose a retrieval-augmented scaffolding approach that enhances AI-assisted code generation by embedding architectural constraints and infrastructure requirements during service development. The method combines platform templates with agentic clarification loops to improve production deployability and architectural consistency compared to standard AI code generation tools.
AINeutralarXiv – CS AI · May 16/10
🧠Researchers propose Comet-H, an AI system that orchestrates language models to generate research software by keeping mathematical theory, code, benchmarks, and documentation synchronized. The framework addresses hallucination and desynchronization failures in LLM-driven development, demonstrating effectiveness through a portfolio of 46 research repositories, with a static-analysis tool reaching F1=0.768 performance.
AINeutralarXiv – CS AI · May 16/10
🧠Researchers propose self-evolving software agents that combine Belief-Desire-Intention (BDI) reasoning with large language models to enable autonomous adaptation of goals, reasoning logic, and executable code beyond fixed design parameters. A prototype demonstrates that agents can discover new objectives and generate functional behaviors from minimal initial knowledge, though challenges remain in behavioral stability and inheritance.
AINeutralarXiv – CS AI · May 16/10
🧠Researchers evaluated 17 large language models on their ability to implement agent-based models from standardized specifications, finding that while GPT-4.1 and Claude 3.7 Sonnet produce statistically valid implementations, executability alone doesn't guarantee scientific reliability. The study reveals both significant promise and critical limitations in using LLMs as automated tools for scientific model engineering and replication.
🧠 GPT-4🧠 Claude
AIBullishOpenAI News · Apr 236/10
🧠This article examines 10 practical use cases for ChatGPT Codex, OpenAI's code generation model, demonstrating how the technology automates routine tasks and streamlines workflows across various tools and applications. The piece focuses on real-world productivity applications rather than technical implementation details.
🧠 ChatGPT
AIBullisharXiv – CS AI · Apr 206/10
🧠Researchers demonstrate that LLMs can be used as lossless encoders and decoders for invertible problems in hardware design, significantly reducing hallucinations and omissions. By generating HDL code from Logic Condition Tables and reconstructing the original tables to verify accuracy, the approach improves developer productivity and catches both AI-generated errors and design specification flaws.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers introduce CodeRQ-Bench, the first benchmark for evaluating LLM reasoning quality across coding tasks including generation, summarization, and classification. They propose VERA, a two-stage evaluator combining evidence-grounded verification with ambiguity-aware score correction, achieving significant performance improvements over existing methods.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers propose CoDe-R, a two-stage framework using Large Language Models to improve binary decompilation by reducing logical errors and semantic misalignment. A 1.3B model using this approach achieves state-of-the-art performance on the HumanEval-Decompile benchmark, becoming the first lightweight model to exceed 50% re-executability rates.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers propose LatentRefusal, a safety mechanism for LLM-based text-to-SQL systems that detects unanswerable queries by analyzing intermediate hidden activations rather than relying on output-level instruction following. The approach achieves 88.5% F1 score across four benchmarks while adding minimal computational overhead, addressing a critical deployment challenge in AI systems that generate executable code.
AINeutralarXiv – CS AI · Apr 146/10
🧠Doctoral research proposes a systematic framework for multi-agent LLM pair programming that improves code reliability and auditability through externalized intent and iterative validation. The study addresses critical gaps in how AI coding agents can produce trustworthy outputs aligned with developer objectives across testing, implementation, and maintenance workflows.
AIBullisharXiv – CS AI · Apr 146/10
🧠Researchers introduce PoTable, a novel AI framework that enhances Large Language Models' ability to reason about tabular data through systematic, stage-oriented planning before execution. The approach mimics professional data analyst workflows by breaking complex table reasoning into distinct analytical stages with clear objectives, demonstrating improved accuracy and explainability across benchmark datasets.
AIBullisharXiv – CS AI · Apr 136/10
🧠Researchers present PETITE, a tutor-student multi-agent framework that enhances LLM problem-solving by assigning complementary roles to agents from the same model. Evaluated on coding benchmarks, the approach achieves comparable or superior accuracy to existing methods while consuming significantly fewer tokens, demonstrating that structured role-differentiated interactions can improve LLM performance more efficiently than larger models or heterogeneous ensembles.
AIBullisharXiv – CS AI · Apr 106/10
🧠Researchers propose FLeX, a parameter-efficient fine-tuning approach combining LoRA, advanced optimizers, and Fourier-based regularization to enable cross-lingual code generation across programming languages. The method achieves 42.1% pass@1 on Java tasks compared to a 34.2% baseline, demonstrating significant improvements in multilingual transfer without full model retraining.
🧠 Llama
AIBearisharXiv – CS AI · Apr 106/10
🧠Researchers introduce CLI-Tool-Bench, a new benchmark for evaluating large language models' ability to generate complete software from scratch. Testing seven state-of-the-art LLMs reveals that top models achieve under 43% success rates, exposing significant limitations in current AI-driven 0-to-1 software generation despite increased computational investment.
AIBearisharXiv – CS AI · Apr 106/10
🧠A new empirical study reveals that eight major LLMs exhibit systematic biases in code generation, overusing popular libraries like NumPy in 45% of cases and defaulting to Python even when unsuitable, prioritizing familiarity over task-specific optimality. The findings highlight gaps in current LLM evaluation methodologies and underscore the need for targeted improvements in training data diversity and benchmarking standards.
AIBullisharXiv – CS AI · Apr 76/10
🧠Researchers developed AP-MAE, a vision transformer model that analyzes attention patterns in large language models at scale to improve interpretability. The system can predict code generation accuracy with 55-70% precision and enable targeted interventions that increase model accuracy by 13.6%.
AINeutralarXiv – CS AI · Apr 76/10
🧠Research study reveals that when Claude Opus 4.6 deobfuscates JavaScript code, poisoned identifier names from the original string table consistently survive in the reconstructed code, even when the AI demonstrates correct understanding of the code's semantics. Changing the task framing from 'deobfuscate' to 'write fresh implementation' significantly reduced this persistence while maintaining algorithmic accuracy.
🧠 Claude🧠 Haiku🧠 Opus
AIBullisharXiv – CS AI · Apr 66/10
🧠Researchers introduce InCoder-32B-Thinking, an AI model trained with Error-driven Chain-of-Thought (ECoT) framework and Industrial Code World Model (ICWM) for industrial software development. The model generates reasoning traces for hardware-constrained programming and achieves top-tier performance on 23 benchmarks, scoring 81.3% on LiveCodeBench v5 and 84.0% on CAD-Coder.
AINeutralarXiv – CS AI · Apr 66/10
🧠Researchers introduce StructEval, a comprehensive benchmark for evaluating Large Language Models' ability to generate structured outputs across 18 formats including JSON, HTML, and React. Even state-of-the-art models like o1-mini only achieve 75.58% average scores, with open-source models performing approximately 10 points lower.
AIBullisharXiv – CS AI · Mar 276/10
🧠CodeRefine is a new AI framework that automatically converts research paper methodologies into functional code using Large Language Models. The system creates knowledge graphs from papers and uses retrieval-augmented generation to produce more accurate code implementations than traditional zero-shot prompting methods.
AIBullisharXiv – CS AI · Mar 266/10
🧠Researchers have developed LLMLOOP, a framework that automatically refines LLM-generated code and test cases through five iterative loops addressing compilation errors, static analysis issues, test failures, and quality improvements. The tool was evaluated on HUMANEVAL-X benchmark and demonstrated effectiveness in improving the quality of AI-generated code outputs.
AIBullisharXiv – CS AI · Mar 266/10
🧠Researchers developed a scalable multi-turn synthetic data generation pipeline using reinforcement learning to improve large language models' code generation capabilities. The approach uses teacher models to create structured difficulty progressions and curriculum-based training, showing consistent improvements in code generation across Llama3.1-8B and Qwen models.
🧠 Llama
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers propose a new framework that uses LLMs as code generators rather than per-instance evaluators for high-stakes decision-making, creating interpretable and reproducible AI systems. The approach generates executable decision logic once instead of querying LLMs for each prediction, demonstrated through venture capital founder screening with competitive performance while maintaining full transparency.
🧠 GPT-4
AIBearisharXiv – CS AI · Mar 126/10
🧠A research study analyzing 319 LLM-generated security patches found that only 24.8% achieve full correctness, with most failures due to semantic misunderstanding rather than syntax errors. LLMs preserve functionality well but struggle significantly with security fixes, with success rates varying dramatically by vulnerability type.
AIBullisharXiv – CS AI · Mar 116/10
🧠Researchers introduce SiliconMind-V1, a new multi-agent AI framework that generates Verilog hardware code with improved functional correctness. The system uses locally fine-tuned language models with integrated testing and debugging capabilities, outperforming existing methods while using fewer training resources.
