Differences

This shows you the differences between two versions of the page.

--- ai [2023/04/17 12:01] – brad
+++ ai [2025/07/12 10:37] (current) – [References] brad
@@ Line 3: / Line 3: @@
 > //We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run. - Roy Amara//
-Towards an understanding of current issues.  Most of the content here is about generative AI (large language models and diffusion models) which is the hot topic as of February 2023, but there's a scattering of broader AI history and issues as well. [[#end_of_page|Jump to end.]]
+Most of the content here is about generative AI (large language models and diffusion models) which is the hot topic as of February 2023, but there's a scattering of broader AI history and issues as well. [[#end_of_page|Jump to end.]]
 Caveats:
+  * **Mostly stopped updating in April 2023, keeping up got exhausting.** There are better sources out there for current developments. Consider this a static account of the late 2022/early 2023 hype.
   * I am not a machine learning expert nor do I work in the field. This page is a scratchpad, reflecting my current efforts to catch up in my understanding of the tech and surrounding issues.
   * All comments and opinions are my own, and are not intended to reflect the positions of my employer or anyone affiliated with me.
@@ Line 139: / Line 140: @@
 [[#ref2010|2010]], [[#ref2015|2015]], [[#ref2016|2016]], [[#ref2017|2017]], [[#ref2018|2018]], [[#ref2019|2019]], [[#ref2020|2020]], [[#ref2021|2021]]\\
 : [[#ref2022_01|Jan]], [[#ref2022_02|Feb]], [[#ref2022_03|Mar]], [[#ref2022_04|Apr]], [[#ref2022_05|May]], [[#ref2022_06|Jun]], [[#ref2022_07|Jul]], [[#ref2022_08|Aug]], [[#ref2022_09|Sep]], [[#ref2022_10|Oct]], [[#ref2022_11|Nov]], [[#ref2022_12|Dec]]\\
-: [[#ref2023_01|Jan]], [[#ref2023_02|Feb]], [[#ref2023_03|Mar]], [[#ref2023_04|Apr]]
+: [[#ref2023_01|Jan]], [[#ref2023_02|Feb]], [[#ref2023_03|Mar]], [[#ref2023_04|Apr]], [[#ref2023_07|Jul]]
+[[#ref2025|2025]]
 <BOOKMARK:ref2010>
@@ Line 665: / Line 667: @@
 -04-10.a [[https://archive.is/upxPn|OpenAI CEO Plans Japan Expansion After Prime Minister Meeting.]] Yuki Hagiwara, Bloomberg, April 10. (Business)
+-04-11.a [[https://huyenchip.com/2023/04/11/llm-engineering.html|Building LLM applications for production.]] Chip Huyen, Apr 11. (Explainers)
 -04-12.a [[https://github.com/databrickslabs/dolly/tree/master/data|databricks-dolly-15k is an open source dataset of instruction-following records.]] Databricks. With a permissive creative commons license.
+-04-12.b [[https://txt.cohere.ai/what-are-transformer-models/|What Are Transformer Models and How Do They Work?]] Luis Serrano, Cohere, Apr 12. (Explainers)
+-04-16.a [[https://magazine.sebastianraschka.com/p/understanding-large-language-models|Understanding Large Language Models: A Cross-Section of the Most Relevant Literature To Get Up to Speed.]] Sebastian Raschka, Apr 16. (Explainers)
 -04-17.a [[https://www.bbc.com/news/entertainment-arts-65298834|AI-generated Drake and The Weeknd song goes viral.]] Mark Savage, BBC News, Apr 17. A song [[https://www.youtube.com/watch?v=VszJPLAtK0U|"Heart On My Sleeve"]] using the cloned voices of Drake and The Weeknd is viewed 8.5 million times over the weekend.
 -04-17.b [[https://www.together.xyz/blog/redpajama|RedPajama, a project to create leading open-source models, starts by reproducing LLaMA training dataset of over 1.2 trillion tokens.]] (Research)
+-04-17.c [[https://minigpt-4.github.io/|MiniGPT-4: Enhancing Vision-language Understanding with Advanced Large Language Models.]] (Research)
+-04-17.d [[https://www.wired.com/story/openai-ceo-sam-altman-the-age-of-giant-ai-models-is-already-over/|OpenAI’s CEO Says the Age of Giant AI Models Is Already Over.]] Will Knight, Wired, Apr 17.
+-04-19.a [[https://www.washingtonpost.com/technology/interactive/2023/ai-chatbot-learning/|Inside the secret list of websites that make AI like ChatGPT sound smart.]] Washington Post, Apr 19.
+<BOOKMARK:ref2023_07>
+-07-06.a [[https://openai.com/blog/gpt-4-api-general-availability|GPT-4 is Generally Available.]]
+<BOOKMARK:ref2025>
+-05-21.a [[https://codemanship.wordpress.com/2025/05/21/five-boring-things-that-have-a-bigger-impact-than-a-i-coding-assistants-on-dev-team-productivity/|Five Boring Things That Have A Bigger Impact Than “A.I.” Coding Assistants On Dev Team Productivity.]] Jason Gorman, Codemanship. The 5 things: Smaller teams yield better ROI; frequent releases accelerate learning; limiting work in progress increases throughput; cross-functional teams hit fewer bottlenecks; empowered teams spend less time blocked.
+-05-27.a [[https://adactio.com/journal/21933|Uses.]] Jeremy Keith, Adactio. "I don’t use large language models. My objection to using them is ethical."
+-06-04.a [[https://blog.glyph.im/2025/06/i-think-im-done-thinking-about-genai-for-now.html|I Think I’m Done Thinking About genAI For Now.]] Glyph Lefkowitz, Deciphering Glyph. "I am writing this piece to make my peace with giving up on this topic, at least for a while. While I do idly hope that some folks might find bits of it convincing, and perhaps find ways to be more mindful with their own usage of genAI tools, and consider the harm they may be causing, that’s not actually the goal. And that is not the goal because it is just so much goddamn work to prove."
+-06-05.a [[https://www.eff.org/deeplinks/2025/06/keeping-web-under-weight-ai-crawlers|Keeping the Web Up Under the Weight of AI Crawlers.]] Starchy Grant for EFF. "For-profit AI companies must ensure they do not poison the well of the open web they rely on in a short-sighted rush for training data."
+-06-07.a [[https://ml-site.cdn-apple.com/papers/the-illusion-of-thinking.pdf|The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity.]] Apple research, June 2025.
+-06-07.b [[https://www.nytimes.com/2025/06/07/technology/chatgpt-openai-colleges.html|Welcome to Campus. Here’s Your ChatGPT.]] OpenAI, the firm that helped spark chatbot cheating, wants to embed A.I. in every facet of college. First up: 460,000 students at Cal State. Jamie Kelter Davis for The New York Times.
+-06-08.a [[https://surfingcomplexity.blog/2025/06/08/ai-at-amazon-a-case-study-of-brittleness/|AI at Amazon: a case study of brittleness.]] Lorin Hochstein, Surfing Complexity.
+-06-09.a [[https://www.energymonitor.ai/news/international-telecommunication-union-operational-emissions/|Tech giants’ carbon emissions up 150% with AI growth.]] Energy Monitor.
+-06-11.a [[https://www.baldurbjarnason.com/2025/followup-on-trusting-your-own-judgement/|Avoiding generative models is the rational and responsible thing to do – follow-up to “Trusting your own judgement on ‘AI...’”]] Baldur Bjarnson.
+-06-13.a [[https://www.nytimes.com/2025/06/13/technology/chatgpt-ai-chatbots-conspiracies.html?unlocked_article_code=1.Ok8.BOD8.YrPWpWHIjMPa|They Asked an A.I. Chatbot Questions. The Answers Sent Them Spiraling.]] Kashmir Hill, The New York Times.
+-07-06.a [[https://addxorrol.blogspot.com/2025/07/a-non-anthropomorphized-view-of-llms.html|A non-anthropomorphized view of LLMs.]] Halvar Flake.
+-07-06.b [[https://www.tbray.org/ongoing/When/202x/2025/07/06/AI-Manifesto|The Real GenAI Issue.]] Tim Bray.
+-07-06.c [[https://openletter.earth/an-open-letter-from-educators-who-refuse-the-call-to-adopt-genai-in-education-cb4aee75|An open letter from educators who refuse the call to adopt GenAI in education.]]
 <BOOKMARK:end_of_page>

Commonplace

Page Tools

Site Tools

User Tools

Differences