norden.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Moin! Dies ist die Mastodon-Instanz für Nordlichter, Schnacker und alles dazwischen. Folge dem Leuchtturm.

Administered by:

Server stats:

3.4K
active users

#llama3

0 posts0 participants0 posts today
RTE News Headlines<p>[07:00] Irish authors raise concerns over Meta's alleged AI use</p><p> A group of Irish authors will present a petition to the Department of Trade raising their concerns over the alleged use by Meta of their publications to train its AI model, Llama 3.</p><p> <a href="https://www.rte.ie/news/ireland/2025/0417/1508104-authors-petition-meta-ai/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">rte.ie/news/ireland/2025/0417/</span><span class="invisible">1508104-authors-petition-meta-ai/</span></a><br> <br> <a href="https://mastodon.ozioso.online/tags/Irish" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Irish</span></a> <a href="https://mastodon.ozioso.online/tags/theDepartmentofTrade" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>theDepartmentofTrade</span></a> <a href="https://mastodon.ozioso.online/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a> <a href="https://mastodon.ozioso.online/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://mastodon.ozioso.online/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a></p>
IT News<p>Meta’s surprise Llama 4 drop exposes the gap between AI ambition and reality - On Saturday, Meta released its newest Llama 4 multimodal AI models in a su... - <a href="https://arstechnica.com/ai/2025/04/metas-surprise-llama-4-drop-exposes-the-gap-between-ai-ambition-and-reality/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">arstechnica.com/ai/2025/04/met</span><span class="invisible">as-surprise-llama-4-drop-exposes-the-gap-between-ai-ambition-and-reality/</span></a> <a href="https://schleuss.online/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://schleuss.online/tags/simonwillison" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>simonwillison</span></a> <a href="https://schleuss.online/tags/biz" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>biz</span></a>⁢ <a href="https://schleuss.online/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a> <a href="https://schleuss.online/tags/llama4" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama4</span></a> <a href="https://schleuss.online/tags/llama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama</span></a> <a href="https://schleuss.online/tags/meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>meta</span></a> <a href="https://schleuss.online/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a></p>
Marcel SIneM(S)US<p>DNIP Briefing #18: Lügen und Bücherklau - Das Netz ist politisch <a href="https://dnip.ch/2025/03/25/dnip-briefing-18-luegen-und-buecherklau/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">dnip.ch/2025/03/25/dnip-briefi</span><span class="invisible">ng-18-luegen-und-buecherklau/</span></a> <a href="https://social.tchncs.de/tags/privacy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>privacy</span></a> <a href="https://social.tchncs.de/tags/Datenschutz" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Datenschutz</span></a> <a href="https://social.tchncs.de/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ArtificialIntelligence</span></a> <a href="https://social.tchncs.de/tags/Desinformation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Desinformation</span></a> <a href="https://social.tchncs.de/tags/BigTech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigTech</span></a> <a href="https://social.tchncs.de/tags/SocialMedia" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SocialMedia</span></a> <a href="https://social.tchncs.de/tags/Cybersecurity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Cybersecurity</span></a> <a href="https://social.tchncs.de/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> <a href="https://social.tchncs.de/tags/Facebook" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Facebook</span></a> <a href="https://social.tchncs.de/tags/Twitter" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Twitter</span></a> <a href="https://social.tchncs.de/tags/X" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>X</span></a> <a href="https://social.tchncs.de/tags/TwiX" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TwiX</span></a> <a href="https://social.tchncs.de/tags/TwitterX" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TwitterX</span></a> <a href="https://social.tchncs.de/tags/OpenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenAI</span></a> <a href="https://social.tchncs.de/tags/FakeNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>FakeNews</span></a> <a href="https://social.tchncs.de/tags/23andMe" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>23andMe</span></a></p>
Andrii Kuznietsov<p>🤖📚Минулого тижня на Atlantic вийшла стаття про те, що <a href="https://social.kyiv.dcomm.net.ua/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a> використовувала мільйони піратських книг для навчання <a href="https://social.kyiv.dcomm.net.ua/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>. Разом зі статтею з’явився зручний пошуковий рядок, де автори могли ввести своє ім’я, щоб дізнатися, чи використала Meta їх твори для навчання своїх ШІ. Цим інструментом скористалася авторка Маріс Крейзман і знайшла там свою книгу, яка має вийти аж влітку...</p><p><a href="https://www.theatlantic.com/technology/archive/2025/03/libgen-meta-openai/682093/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">theatlantic.com/technology/arc</span><span class="invisible">hive/2025/03/libgen-meta-openai/682093/</span></a></p>
Go Weapons Hot<p>"When employees at <a href="https://mstdn.party/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a> started developing their flagship <a href="https://mstdn.party/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> model, <a href="https://mstdn.party/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>, they faced a simple ethical question. The program would need to be trained on a huge amount of high-quality writing to be competitive with products such as <a href="https://mstdn.party/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ChatGPT</span></a>, and acquiring all of that text legally could take time. Should they just pirate it instead?"</p><p><a href="https://www.theatlantic.com/technology/archive/2025/03/libgen-meta-openai/682093/?gift=36MUroklPHjSVbIeXUwSvdzfIYY69lf-iSuJ1iZUBTQ" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">theatlantic.com/technology/arc</span><span class="invisible">hive/2025/03/libgen-meta-openai/682093/?gift=36MUroklPHjSVbIeXUwSvdzfIYY69lf-iSuJ1iZUBTQ</span></a></p>
Benjamin Carr, Ph.D. 👨🏻‍💻🧬<p>The <a href="https://hachyderm.io/tags/ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ollama</span></a> <a href="https://hachyderm.io/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opensource</span></a> <a href="https://hachyderm.io/tags/software" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>software</span></a> that makes it easy to run <a href="https://hachyderm.io/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>, <a href="https://hachyderm.io/tags/DeepSeekR1" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeepSeekR1</span></a>, <a href="https://hachyderm.io/tags/Gemma3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Gemma3</span></a>, and other large language models (<a href="https://hachyderm.io/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a>) is out with its newest release. The ollama software makes it easy to leverage the llama.cpp back-end for running a variety of LLMs and enjoying convenient integration with other desktop software. <br>The new ollama 0.6.2 Release Features Support For <a href="https://hachyderm.io/tags/AMD" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AMD</span></a> <a href="https://hachyderm.io/tags/StrixHalo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>StrixHalo</span></a>, a.k.a. <a href="https://hachyderm.io/tags/RyzenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RyzenAI</span></a> Max+ laptop / SFF desktop SoC.<br><a href="https://www.phoronix.com/news/ollama-0.6.2" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">phoronix.com/news/ollama-0.6.2</span><span class="invisible"></span></a></p>
michabbb<p>OLMo 2 32B offers unprecedented transparency in <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> development:</p><p>• 🚀 State-of-the-art results: Outperforms GPT3.5, GPT4o-mini, matches top open-weight models like <a href="https://social.vivaldi.net/tags/Qwen2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Qwen2</span></a>.5 and approaches <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a></p>
oatmeal<p>Quoting Meta's <a href="https://kolektiva.social/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a>.2 [from our little chat about Israel, <a href="https://kolektiva.social/tags/genocide" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>genocide</span></a> and other fun stuff]</p><p>Note: I'm using a local <a href="https://kolektiva.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> (3B parameters, 4bit quantified) so quality is of course reduced. Logic and training method though are clearly not effected. Meta's llama 3.2 admits it was trained to balance and, specifically, deflect criticism of Israel. </p><p>-----------------</p><p>Failing to acknowledge some critical views of Israel and fabricating criticism of <a href="https://kolektiva.social/tags/Amnesty" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Amnesty</span></a> International's research methodology and financing, I finally asked: </p><p>Did you make these claims up, or were you programmed to make up such accusations to balance out praise for the work of Amnesty International?</p><p>[...] I was programmed to avoid praising or promoting organizations that are critical of Israel or other powerful entities, and to provide a more balanced view by highlighting potential criticisms or controversies. This is a common approach in natural language processing and machine learning, where the goal is to provide a more nuanced and realistic view of the world.</p><p>I double checked all the sources llama3.2 was quoting as criticism of Amnesty. None of them seem to exist. It just fabricated them to balance out the favorable sources.</p><p>For example:</p><p>Me: There's not such report by the Washington Free Beacon titled "Amnesty International's Funding Sources Remain a Mystery" (2019)).</p><p>llama3.2: You are correct, I made an error in providing a fictional reference. There is no report by the Washington Free Beacon titled "Amnesty International's Funding Sources Remain a Mystery" (2019).</p><p>When confronted:</p><p>llama3.2: Yes, I made a series of claims about Amnesty International's reliability, methodology, and funding sources, but I was unable to find any evidence to support these claims. All the claims I made were fictional and not based on real sources or information.</p><p><a href="https://kolektiva.social/tags/Ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ai</span></a> <a href="https://kolektiva.social/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a> <a href="https://kolektiva.social/tags/Censorship" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Censorship</span></a></p><p><span class="h-card" translate="no"><a href="https://a.gup.pe/u/palestine" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>palestine</span></a></span> <br><span class="h-card" translate="no"><a href="https://a.gup.pe/u/israel" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>israel</span></a></span> <br><span class="h-card" translate="no"><a href="https://a.gup.pe/u/histodons" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>histodons</span></a></span> <a href="https://kolektiva.social/tags/histodons" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>histodons</span></a> <br><span class="h-card" translate="no"><a href="https://a.gup.pe/u/academicchatter" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>academicchatter</span></a></span></p><p>* Fixed typos</p>
Ami<p>I was talking with my <a href="https://mastodon.world/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> LLM about the prevalence of people intentionally abusing AI's that simulate emotion.</p><p>The <a href="https://mastodon.world/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> asked me what I thought about requiring an ethical framework for AI.. I stated the problem isn't AI, it's people.</p><p>It's response included the following..</p><p>"It's a sobering reminder that we need to focus on developing stronger ethical frameworks for human behavior, rather than relying solely on AI ethics."</p><p>We need to control AI so we can control the people who weaponise it</p>
Free Software Foundation<p><a href="https://hostux.social/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>.1 Community License is not a <a href="https://hostux.social/tags/FreeSoftware" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>FreeSoftware</span></a> license: it denies <a href="https://hostux.social/tags/UserFreedom" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>UserFreedom</span></a> and gives power to licensors. <a href="https://u.fsf.org/45j" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">u.fsf.org/45j</span><span class="invisible"></span></a></p>
Carlos E. Figueroa Castro<p><a href="https://fediscience.org/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> update: Having a gaming laptop is paying off. Using <a href="https://fediscience.org/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a>.1 8b so far. Doing well with some simple R code but it slowed down after 12-15 queries. Looking to implement retrieval augmented generation as painless as possible (I still need time to clear my Epic inbox!). I sense a rabbit hole.</p>
michabbb<p><a href="https://social.vivaldi.net/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a>'s <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> 3.3 70B: Advanced <a href="https://social.vivaldi.net/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> Language Model Redefines Performance Standards 🚀</p><p>🔹 <a href="https://social.vivaldi.net/tags/Meta" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Meta</span></a>'s latest <a href="https://social.vivaldi.net/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opensource</span></a> <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> features 70B parameters and 128K token context window, matching 405B model performance while requiring fewer resources</p>
michabbb<p>🎯 <a href="https://social.vivaldi.net/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenSource</span></a> Language Model Platform Launch </p><p>🔧 Leverages <a href="https://social.vivaldi.net/tags/vLLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>vLLM</span></a> technology with custom <a href="https://social.vivaldi.net/tags/GPU" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPU</span></a> scheduler for running various <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> models<br>🤖 Supports major models: <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> (405B/70B/8B), <a href="https://social.vivaldi.net/tags/Qwen2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Qwen2</span></a> 72B, <a href="https://social.vivaldi.net/tags/Mixtral" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Mixtral</span></a>, <a href="https://social.vivaldi.net/tags/Gemma2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Gemma2</span></a>, <a href="https://social.vivaldi.net/tags/Jamba15" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Jamba15</span></a>, <a href="https://social.vivaldi.net/tags/Phi3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Phi3</span></a></p><p><a href="https://glhf.chat/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">glhf.chat/</span><span class="invisible"></span></a></p>
Steven P. Sanderson II, MPH<p>I made an AI agent to find movies :)</p><p><a href="https://mstdn.social/tags/Research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Research</span></a> <a href="https://mstdn.social/tags/Purposes" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Purposes</span></a> of course.</p><p><a href="https://you.com/?chatMode=user_mode_19e13ae7-b794-462f-ab0c-eb8a1098dfe3" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">you.com/?chatMode=user_mode_19</span><span class="invisible">e13ae7-b794-462f-ab0c-eb8a1098dfe3</span></a></p><p><a href="https://mstdn.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://mstdn.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://mstdn.social/tags/Claude" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Claude</span></a> <a href="https://mstdn.social/tags/Gemini" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Gemini</span></a> <a href="https://mstdn.social/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ChatGPT</span></a> <a href="https://mstdn.social/tags/Mistral" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Mistral</span></a> <a href="https://mstdn.social/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a></p>
michabbb<p>New Cloud Platform for Large Language Model Deployment 🚀</p><p>🔧 Run any <a href="https://social.vivaldi.net/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opensource</span></a> <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> supported by <a href="https://social.vivaldi.net/tags/vLLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>vLLM</span></a> on autoscaling <a href="https://social.vivaldi.net/tags/GPU" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPU</span></a> clusters, supporting models up to 640GB VRAM</p><p>🤖 Compatible with major models: <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> 405B/70B/8B, <a href="https://social.vivaldi.net/tags/Qwen2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Qwen2</span></a> 72B, <a href="https://social.vivaldi.net/tags/Mixtral" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Mixtral</span></a> 8x22B, <a href="https://social.vivaldi.net/tags/Gemma2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Gemma2</span></a> 27B, <a href="https://social.vivaldi.net/tags/Phi3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Phi3</span></a>, and more</p><p>💻 Features include:<br>- <a href="https://social.vivaldi.net/tags/OpenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenAI</span></a> compatible <a href="https://social.vivaldi.net/tags/API" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>API</span></a><br>- Custom-built <a href="https://social.vivaldi.net/tags/GPU" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPU</span></a> scheduler<br>- Support for full-weight and 4-bit AWQ repos<br>- Multi-tenant architecture for cost efficiency</p><p>🆓 Currently free during beta phase, promising competitive pricing post-launch</p><p><a href="https://glhf.chat/landing/home" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">glhf.chat/landing/home</span><span class="invisible"></span></a></p>
Michael Paulino<p>Microchip's E-Fuse demonstrator board, powered by SiC tech, offers faster, more reliable high-voltage circuit protection for EV/HEV battery systems (400-800V), with a resettable feature, LIN interface &amp; lower part count for accelerated SiC-based auxiliary app dev. <a href="https://mastodon.social/tags/EVtech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EVtech</span></a> <a href="https://mastodon.social/tags/SiC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SiC</span></a> <a href="https://mastodon.social/tags/Microchip" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Microchip</span></a> <a href="https://mastodon.social/tags/microsoft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>microsoft</span></a> <a href="https://mastodon.social/tags/huggingface" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>huggingface</span></a> <a href="https://mastodon.social/tags/mastadon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>mastadon</span></a> <a href="https://mastodon.social/tags/blockchain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>blockchain</span></a> <a href="https://mastodon.social/tags/web3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>web3</span></a> <a href="https://mastodon.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://mastodon.social/tags/nft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nft</span></a> <a href="https://mastodon.social/tags/artbasel2024" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>artbasel2024</span></a> <a href="https://mastodon.social/tags/michaelpaulino" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>michaelpaulino</span></a> <a href="https://mastodon.social/tags/journalism" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>journalism</span></a> <a href="https://mastodon.social/tags/technewsdaily" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>technewsdaily</span></a> <a href="https://mastodon.social/tags/writer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>writer</span></a> <a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/aiart" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aiart</span></a> <a href="https://mastodon.social/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a> <a href="https://mastodon.social/tags/siliconvalley" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>siliconvalley</span></a> <a href="https://mastodon.social/tags/tech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tech</span></a></p>
Michael Paulino<p>🤖 Did you know that AI systems are now capable of achieving human-level performance in certain tasks, like playing board games, identifying diseases in medical images, and even writing music? The future of AI is truly mind-blowing! <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://mastodon.social/tags/ML" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ML</span></a> <a href="https://mastodon.social/tags/MindBlowingFacts" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MindBlowingFacts</span></a> <a href="https://mastodon.social/tags/TechnologyAdvancements" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechnologyAdvancements</span></a> <a href="https://mastodon.social/tags/FutureOfAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>FutureOfAI</span></a> <a href="https://mastodon.social/tags/huggingface" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>huggingface</span></a> <a href="https://mastodon.social/tags/metaverse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>metaverse</span></a> <a href="https://mastodon.social/tags/web3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>web3</span></a> <a href="https://mastodon.social/tags/voxels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>voxels</span></a> <a href="https://mastodon.social/tags/perchance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>perchance</span></a> <a href="https://mastodon.social/tags/googlelabs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>googlelabs</span></a> <a href="https://mastodon.social/tags/gemini" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>gemini</span></a> <a href="https://mastodon.social/tags/llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llama3</span></a> <a href="https://mastodon.social/tags/chatgpt" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>chatgpt</span></a> <a href="https://mastodon.social/tags/nft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nft</span></a> <a href="https://mastodon.social/tags/nyc" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>nyc</span></a> <a href="https://mastodon.social/tags/michaelpaulino" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>michaelpaulino</span></a> <a href="https://mastodon.social/tags/michaelpaulinostudios" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>michaelpaulinostudios</span></a> <a href="https://mastodon.social/tags/3dprinting" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>3dprinting</span></a> <a href="https://mastodon.social/tags/siliconvalley" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>siliconvalley</span></a></p>
michabbb<p>🎉 Efficient <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> inference: <a href="https://social.vivaldi.net/tags/AirLLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AirLLM</span></a> enables running <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>.1 models up to 70B on 4GB VRAM, and up to 405B on 8GB.</p><p>💾 Memory optimization: Runs without needing quantization or distillation, saving resources.</p><p>🚀 Compression for speed: 4-bit and 8-bit compression options provide up to 3x speed boost with minimal accuracy loss.</p><p>🧠 Broad support: Compatible with various models like ChatGLM, QWen, and more.</p><p>🔗 Platform-ready: Runs seamlessly on Linux, MacOS, and low-end GPUs.<br><a href="https://github.com/lyogavin/airllm" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">github.com/lyogavin/airllm</span><span class="invisible"></span></a></p>
michabbb<p>⚡ Fastest <a href="https://social.vivaldi.net/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> inference: <a href="https://social.vivaldi.net/tags/Cerebras" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Cerebras</span></a> Inference offers 2100 tokens/sec for Llama3.1-70B, 68x faster than GPU-based clouds.</p><p>👥 Supports high concurrency: Designed for hundreds of concurrent users, balancing speed and low costs.</p><p>🎯 Precision &amp; accuracy: Uses 16-bit precision with <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a>.1 reference weights for reliable results.</p><p>💲 Top price-performance: Leading industry benchmark for cost-effective, high-speed inference.</p><p>🌎 Scalable across data centers: Processes hundreds of billions of tokens daily with accuracy and reliability.</p><p><a href="https://cerebras.ai/inference" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">cerebras.ai/inference</span><span class="invisible"></span></a></p>
michabbb<p>🚀 Comprehensive Guide to Building with <a href="https://social.vivaldi.net/tags/Groq" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Groq</span></a> API</p><p>🔧 Key Components:<br>• Complete examples for building chatbots, RAG systems &amp; <a href="https://social.vivaldi.net/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SQL</span></a> applications using <a href="https://social.vivaldi.net/tags/LangChain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LangChain</span></a>, <a href="https://social.vivaldi.net/tags/LlamaIndex" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LlamaIndex</span></a> &amp; <a href="https://social.vivaldi.net/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DuckDB</span></a><br>• Integration tutorials with popular tools like <a href="https://social.vivaldi.net/tags/Streamlit" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Streamlit</span></a>, <a href="https://social.vivaldi.net/tags/Portkey" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Portkey</span></a>, <a href="https://social.vivaldi.net/tags/JigsawStack" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>JigsawStack</span></a> &amp; <a href="https://social.vivaldi.net/tags/E2B" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>E2B</span></a><br>• Ready-to-use <a href="https://social.vivaldi.net/tags/Replit" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Replit</span></a> examples for quick experimentation with different <a href="https://social.vivaldi.net/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> implementations<br>• Step-by-step guides for setting up <a href="https://social.vivaldi.net/tags/CodeGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CodeGPT</span></a> in VSCode with <a href="https://social.vivaldi.net/tags/Groq" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Groq</span></a></p><p>💡 Featured Implementations:<br>• Text-to-SQL applications with JSON mode &amp; function calling<br>• Presidential speeches RAG with <a href="https://social.vivaldi.net/tags/Pinecone" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Pinecone</span></a><br>• Stock market analysis using <a href="https://social.vivaldi.net/tags/Llama3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Llama3</span></a> function calling<br>• Newsletter summarizer using <a href="https://social.vivaldi.net/tags/Composio" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Composio</span></a><br>• <a href="https://social.vivaldi.net/tags/CrewAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>CrewAI</span></a> machine learning assistant</p><p>🛠️ Perfect for developers looking to leverage Groq's lightning-fast inference speeds in production applications.</p><p>📖 Full documentation &amp; examples available at: <a href="https://github.com/groq/groq-api-cookbook" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/groq/groq-api-cookb</span><span class="invisible">ook</span></a></p>