Tag

Data Compression

All articles tagged with #data compression

technology1 year ago•1 min saved

Microsoft Unveils SPREADSHEETLLM for Smarter Spreadsheet Analysis

Microsoft has introduced SPREADSHEETLLM, a framework that enhances the processing and analysis of complex spreadsheet data using large language models (LLMs). Key innovations include SHEETCOMPRESSOR, structural anchor extraction, and inverted-index translation, which collectively improve performance and reduce computational costs. SPREADSHEETLLM achieved state-of-the-art results in experiments, significantly outperforming previous methods and reducing processing costs by 96%. This advancement represents a major step forward in applying LLMs to spreadsheet analysis, enabling more efficient data interactions.

via AIM|

#data-compression #llms #microsoft

cybersecurity1 year ago•0 min saved

"Critical Backdoor Compromise in XZ Utils Library Affects Linux Distributions"

CISA and the open source community are addressing reports of malicious code found in XZ Utils versions 5.6.0 and 5.6.1, potentially allowing unauthorized access to affected systems. Users are advised to downgrade to a secure version, such as XZ Utils 5.4.6 Stable, and to report any suspicious activity to CISA.

via CISA|

#cisa #cve-2024-3094 #cybersecurity

artificial-intelligence2 years ago•3 min saved

Study Finds AI Language Models Surpass PNG and FLAC in Lossless Compression

A research paper by DeepMind reveals that their large language model (LLM) called Chinchilla 70B can achieve better lossless compression than traditional algorithms designed for image and audio compression. The LLM compressed image patches from the ImageNet database to 43.4% of their original size, surpassing the PNG algorithm at 58.5%. For audio, Chinchilla compressed samples from the LibriSpeech dataset to 16.4% of their raw size, outperforming FLAC compression at 30.3%. The study suggests that language models like Chinchilla can be effective tools for compressing various types of data, opening up new possibilities for machine learning models beyond text prediction and writing. The relationship between compression and intelligence is an ongoing area of research and debate.

via Ars Technica|

#artificial-intelligence #compression #data-compression

technology2 years ago•1 min saved

"LLMs Revolutionize Text Compression, Achieving Unprecedented Efficiency"

Fabrice Bellard has developed ts_zip, a text compression tool that utilizes Large Language Models (LLMs) to achieve higher compression ratios than other tools. While LLMs may result in lossy compression, Bellard also offers NNCP, a neural-network powered lossless data compressor for those who require lossless compression. Additionally, Greg Kennedy has created Lossy Text Compression, which uses a thesaurus to swap longer words for shorter ones, providing a simpler and amusing alternative for text compression.

via Hackaday|

#data-compression #large-language-models #lossless-compression