marktechpost4d
AMD Releases AMD-135M: AMD’s First Small Language Model Series Trained from Scratch on AMD Instinct™ MI250 Accelerators Utilizing 670B Tokens
AMD has recently introduced its new language model, AMD-135M or AMD-Llama-135M, which is a significant addition to the landscape of AI models. Based on the LLaMA2 model architecture, this language ...
marktechpost5d
Bridging Policy and Practice: Transparency Reporting in Foundation Models
Foundation models have emerged as transformative digital technologies, introducing new capabilities and risks that have captured unprecedented public attention. However, the current foundation model ...
marktechpost5d
torchao: A PyTorch Native Library that Makes Models Faster and Smaller by Leveraging Low Bit Dtypes, Quantization and Sparsity
PyTorch has officially launched torchao, a comprehensive native library designed to optimize PyTorch models for better performance and efficiency. The launch of this library is a milestone in deep ...
marktechpost6d
Is Scaling the Only Path to AI Supremacy? This AI Paper Unveils ‘Phantom of Latent for Large Language and Vision Models
Large language and vision models (LLVMs) face a critical challenge in balancing performance improvements with computational efficiency. As models grow in size, reaching up to 80B parameters, they ...
marktechpost6d
DP-Norm: A Novel AI Algorithm for Highly Privacy-Preserving Decentralized Federated Learning (FL)
Federated Learning (FL) is a successful solution for decentralized model training that prioritizes data privacy, allowing several nodes to learn together without sharing data. It’s especially ...
marktechpost4d
Exploring the Influence of Code Generation Tools (ChatGPT & GitHub Copilot) on Programming Education
Integrating AI-powered code-generating technologies, such as ChatGPT and GitHub Copilot, is revolutionizing programming education. These tools, by providing real-time assistance to developers, ...
marktechpost4d
Multi-View and Multi-Scale Alignment (MaMA): Advancing Mammography with Contrastive Learning and Visual-Language Pre-training
Multi-View and Multi-Scale Alignment for Mammography Contrastive Learning: Contrastive Language-Image Pre-training (CLIP) has shown potential in medical imaging, but its application to mammography ...
marktechpost5d
Researchers at UC Berkeley Developed DocETL: An Open-Source Low-Code AI System for LLM-Powered Data Processing
As the volume of unstructured data grows in various fields, including healthcare, legal, and finance, the demand for efficient, accurate document processing solutions increases. Handling unstructured ...
marktechpost6d
A Comprehensive Survey of Small Language Models: Architectures, Datasets, and Training Algorithms
Small language models (SLMs) have become a focal point in natural language processing (NLP) due to their potential to bring high-quality machine intelligence to everyday devices. Unlike large language ...
marktechpost6d
SpecEval: A Novel Black-Box Evaluation Framework to Evaluate Code Comprehension in LLMs via Program Specifications
As LLMs become more prevalent in software development, it’s crucial to ensure they can accurately understand, generate, and manipulate code. It can also help determine the suitability of LLMs for real ...
marktechpost7d
Microsoft Releases RD-Agent: An Open-Source AI Tool Designed to Automate and Optimize Research and Development Processes
Microsoft’s release of RD-Agent marks a milestone in the automation of research and development (R&D) processes, particularly in data-driven industries. This cutting-edge tool eliminates repetitive ...
marktechpost5d
AI and Intellectual Property: Who Owns AI-Generated Creations?
As artificial intelligence (AI) continues to advance, it increasingly generates creative works such as art, music, and inventions that challenge traditional notions of intellectual property (IP) ...