AI Unplugged: What’s Really Going On With Language Models?

When we think of AI, the first thing that often comes to mind is generative AI, like chatbots or content generators. However, in a recent article titled “How AI Works” published on January 9, 2024, Nir Zicherman sheds light on the workings of large language models (LLMs) in a way that’s accessible to everyone, not just tech enthusiasts.

Zicherman compares LLMs to sophisticated auto-complete tools. Imagine typing a message, and your device suggests the next word based on what you’ve written before. These models are trained on extensive datasets, operating through learned patterns rather than possessing true understanding or consciousness. Simply put, they don’t “know” what they are talking about—they just analyze data to make educated guesses.

To illustrate this concept, Zicherman uses a relatable meal analogy. Picture yourself at a restaurant: you’re hungry, but you haven’t decided what to order. The waiter, lacking psychic abilities, can’t pinpoint exactly what you want; however, based on past orders and an understanding of the menu, they can suggest options that might satisfy your craving. Similarly, AI predicts the next word in a sequence based on patterns derived from vast amounts of data it has encountered. It’s important to recognize that while AI can make relevant suggestions, it does so without genuine comprehension.

In another insightful article, “What Is ChatGPT Doing … and Why Does It Work?” the author dives deeper into ChatGPT’s mechanisms. At its core, ChatGPT generates text by predicting what word or token should come next based on a massive pool of human-written examples. By analyzing the data, it calculates probabilities and constructs sentences one word at a time. To keep the text engaging and less repetitive, a degree of randomness is introduced, allowing the model to select words that may not always be the highest probability options. This is controlled by a parameter known as “temperature,” which significantly influences the quality and variability of the generated outputs.

In essence, ChatGPT creates human-like text by understanding and predicting word sequences with the help of randomness. This approach results in a rich and dynamic output, steering clear of flat, monotonous prose.

 

### Points of Confusion: The Power of Speech

One question that arises is how modern AI can take inspiration from and reinterpret some of history’s most impactful speeches—like Martin Luther King Jr.’s iconic “I Have a Dream.” For instance, let’s consider a line from his powerful speech: 

“Let freedom ring from the hilltops of New Hampshire. Let freedom ring from the mighty mountains of New York. Let freedom ring from the heightening Alleghenies of Pennsylvania.”

Rewritten with an AI’s touch, it could become something like:

Allow freedom to be expressed from the elevated points of New Hampshire. Enable freedom to be acknowledged across the substantial mountain ranges of New York. Permit freedom to emerge from the prominent Alleghenies of Pennsylvania.

This raises an interesting point about the line between genuine inspiration and mechanical rephrasing. While AI can generate variations of powerful text, the emotional weight and historical context behind the original words are something that it cannot replicate.

The exploration of AI’s capabilities is a fascinating journey, illustrating both its limitations and its potential. As we continue to interact with this technology, it’s essential to cultivate an understanding that while AI can craft sentences and suggest ideas, it does so without the consciousness or emotional depth that defines human creativity. Let’s embrace the advancements while acknowledging the art that remains uniquely human.

The Commonplace Tradition

Oh, organization and I have never exactly been best friends. I wouldn’t call myself super organized, but I have some structure—to keep my digital space from being completely chaotic. I like to keep things simple—partly because I’m a minimalist and partly because I don’t have the patience to spend hours colour-coding files.

Since I prefer a minimalist approach, I avoid unnecessary complexity and follow a hierarchical structure, which means each main folder contains subfolders to help retrieve the documents easily. I might not fit the typical ‘commonplacer’ stereotype, this is my own low-maintenance version. Here is an example of how I maintain my main folders and subfolders.

ENGL 1101 ( Main folder)

Spring 2024 (subfolder)

  • Syllabus
  • Sample assignments
  • Class list
  • Email correspondence
  • Lecture notes
  • Assignments
  • Submitted
  • Graded (with feedback)

ENGL 1102

Fall 2024 (Same structure)

Teaching Resources (Main folder)

  • Lesson Plans
  • Activity Ideas
  • Discussion Prompts
  • Assessment Rubrics

Teaching Portfolio (Main folder)

  • Teaching Philosophy
  • Sample Assignments
  • Student Feedback

My digital world is a bit of a mess, filled with random notes, half-written ideas, screenshots, PDFs, and folders labeled “IMPORTANT” ( even though I often forget about them!). This assignment about creating a digital commonplace book made me revisit my folders and evaluate my current organization system.

While researching digital organization strategies, I realized that my digital life might benefit from a makeover. While I’ve always relied on a folder-based system to keep things organized, I turned to Chat GBT and asked for ways to organize my notes. It gave me a few ways to maintain my folders and suggested apps like Evernote, OneNote, and Notion on how to manage and organize my commonplace book.

Curious, I tried my hands on Notion and found it user-friendly. While I haven’t fully adopted this app yet, my initial experiment with Notion has been promising. I’m excited to see how staying organized with Notion might help me retain information better and work more efficiently. It feels like a step in the right direction for my academic journey! It’s about time my gadgets got a makeover too 🙂

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

My Journey to Literacy

Writing

What is your earliest memory of writing?

Ans: My earliest memory of writing is scribbling on pieces of paper and drawing pictures alongside my doodles. Not sure what I was thinking back then, but I guess that I wanted to give some “visual backup” to my teacher to better understand my masterpiece.

What is your earliest memory of being taught to write?
I remember when I was learning cursive writing.  I found it fascinating to trace letters with colorful crayons. I would get so excited choosing my favorite colors and watching each curve come together.
My grandfather would sit beside me as he watched me trace the letters. He was my personal cheerleader and always gave the best advice.

Did your parents read to you?

Yes, my mother and grandfather did read out stories to me. But, I do not remember my father reading to me.

Did they have books lying around the house?
Not really. I had my school textbooks and some storybooks, which I borrowed from the library.

Did you have an influential school teacher and if so, what do you remember of them?
I have fond memories of my fifth-grade teacher, sister Lauren. The way she articulately read out stories made it so lively and engaging. I can still picture her expressive blue eyes and would credit her for igniting my love for reading.

What part did reading play in your development as a writer?
Reading has been an essential part of my development as a writer. It was like a writing coach who always guided me with grammar, vocabulary, and plot ideas. Books like To Kill a Mockingbird and plays by Shakespeare like Julius Caesar and Tempest gave me insight into how words can sway people’s emotions and decisions. Honestly, I still wish my writing could even come close to theirs—if I could capture just a bit of the depth and impact of their work, I would consider it a huge accomplishment.

Did you ever read a precis or watch a movie instead of reading the book?
I don’t think so! I have always enjoyed reading a book more than watching its movie adaptation. I recall reading “Pride and Prejudice” before seeing the movie, and I felt that the movie could not portray the inner struggles of Elizabeth Bennet as deeply as I felt while reading the novel.

Did you have an influential professor and if so, what do you remember of them?
One professor who really stood out in my academic journey is Professor Wankhede. She was my advisor during my Master’s program.  One thing I remember vividly is how she had been so patient throughout. Whether it was helping me narrow down my research focus, reorganising my ideas, or polishing my language, she consistently approached our discussions with patience and encouragement. “Let’s break this down together,” she would often say, which made complicated topics feel manageable. This way, she instilled in me the significance of clarity and precision in writing. Beyond the technical guidance, Mrs. Wankhede also helped me build confidence in my work. She believed in my potential even when I doubted myself and reminded me that writing is a process of growth, not perfection.


Describe your writing processes and behaviors.
My writing process is all about finding quiet moments to think and write. I prefer writing at night when it is peaceful and calm. It helps my thoughts flow, allowing me to dive deep into my ideas without distractions. For me, sharing my work with friends and peers gives me new perspectives and highlights areas where I can improve. Having someone else look at my writing makes it more refined. I always carry a notebook, taking notes or jotting ideas on pen and paper, which I find much more satisfying than typing. There’s something special about physically writing down my thoughts.

How do you teach writing?

As an instructor for ENGL 1101 and 1102, I cover key writing concepts like developing a strong thesis, organising ideas, and structuring paragraphs. I create a conducive environment where students feel empowered to express their ideas while honing their skills. Providing the students with a structured framework helps them through the writing process, which includes breaking down assignments into manageable steps—brainstorming, outlining, drafting, and revising. This way, the students can develop their ideas step by step. Providing clear rubrics and writing samples helps them understand expectations and see how effective arguments are constructed. I also promote peer reviews and provide constructive, individualised feedback that highlights both strengths and areas for improvement.

Reading

What is your earliest memory of reading?

I have been fond of reading since a young age. Out of the four siblings, I was the only one to get up early in the morning and wait for the newspaperman to deliver the newspaper. My parents always encouraged me to read books, be it comics or novels. Although my parents were never avid readers, they fostered a love for reading in me.

What part does reading play in your writing?

Reading helps me become a better writer! It helps me understand different writing styles, learn new words, and organise my thoughts in a coherent manner.

 Have you ever read a summary or watched a movie instead of reading an assigned book?
Well, honestly, I don’t like watching movies. I would rather read than watch a movie.

Does listening to someone read a book provide you with the same experience as reading it yourself? Elaborate.

No, I can understand better and enjoy when I read a book myself. When I read, I take time to reflect on each part. I feel there is a connection with the content and the author when I read. But when someone else reads aloud to me, I miss the connection.

Opining

Do you have an opinion about the present state of the economy?

No, I do not have an opinion

Do you have an opinion about NATO?

Unfortunately, no.

Do you have an opinion about the relationship between sacrifice and faith?
Yes, I think sacrifice and faith go hand in hand. Sacrifice means giving up something for a bigger purpose, and faith is what helps you take that step. For example, when I started wearing a headscarf for my faith, I chose to honor my beliefs. It wasn’t easy because I knew it would bring attention and questions, but my faith gave me the strength to do it. I believed that by making this small sacrifice, I was staying true to my values and getting closer to what I believe in.

Do you ever use words you can’t define?

No, I try to stick to words I know and feel comfortable using. I like to be clear in my communication, so if I come across any word/words that I am not familiar with, I first look up their definition and then use them. Plus, looking up and knowing new words helps me expand my vocabulary, which is a bonus!

How comfortable are you with saying, “I don’t know.”?
I have no hesitation in saying, “I don’t know.” It is better to admit that you do not know a certain thing rather than cut a sorry figure. I believe it’s important to be honest about what you don’t know rather than pretending or guessing.

 

Thinking

Do you have an internal monologue?
Yes, I do have internal monologue several times. The best time is when I am travelling with no interruptions around me.

Do you ever edit as you narrate to yourself?
Yes, I often edit as I narrate to myself. When thinking through ideas or trying to figure out how to explain something, I often find myself mentally restructuring my thoughts.

What is it like to think wordlessly?
Thinking wordlessly? For me, it feels like a disability; my brain depends on words to function. Thinking without words just doesn’t happen for me. Words help me understand everything around me, from my feelings to the little things I do every day, like deciding what to cook for the family. I wouldn’t be able to think straight, and even simple tasks would turn chaotic.

 Is there a difference between rationalizing and thinking?
Thinking seeks truth, while rationalizing runs away from it.

AIing

Have you used AI?

Yes, I use AI regularly.

How many times?

I use AI almost every day- be it to seek answers or explore some new ideas. I use it for my personal as well as my professional life.

Toward what ends?

I regularly use AI tools like ChatGPT, Gemini, and Perplexity to brainstorm new ideas or explore different approaches to a project or lesson plan.

Current thoughts about it?

AI really surprises me! Whether it is composing a poem or helping with medical diagnoses, it can do almost anything I ask it to do. Of course, it can’t replace human creativity or the personal touch, but it has definitely made my life easier. At the same time, I am nervous about how quickly technology is advancing and the potential unintended consequences that come with it. Personally, I feel that it is crucial to strike a balance between embracing the possibilities it offers and being mindful of its impact on society and personal values.