On Wed, Jan 4, 2023 at 4:34 PM Wes Turner <wes.tur...@gmail.com> wrote:
> What are the expected limitations of [ChatGPT]? > > What is "Prompt Engineering"? > [Prompt engineering - Wikipedia]( > https://en.wikipedia.org/wiki/Prompt_engineering ) > > What lessons about technology reliance could you teach, in regards to > Clippy? > > - "What is ChatGPT? Wrong answers only" > - Human_n: EDGES WITH REASONING > > - "Tell me IDK ("I don't know") when you don't know" > - What are "Truthiness", Confidence Intervals and Error Propagation? - What is Convergence? - What does it mean for algorithmic outputs to converge given additional parametric noise? > > - "How certain are you that that is the correct answer?" > - How does [ChatGPT] handle known-to-be or presumed-to-be unsolved math and physics problems? - "How do we create room-temperature superconductivity?" - "How will planetary orbital trajectories change in the n-body gravity problem if another dense probably interstellar mass passes through our local system?" > > - "Are static analysis code metrics sufficient for Safety Critical code?" > - Where in the DevOpSec software development lifecycle should human code review for security best practices and common vulnerabilities and weaknesses? - Is the [ChatGPT] model trained from *only* Formally Verified code with associated tests? - Branch and line coverage metrics indicate which tests run which lines of which functions. Code coverage typically implies dynamic analysis? > > - "Whose code is this based on?" > > - "Where and when did you learn this?" > - Explainability (XAI) - How can models "Unlearn" or "Learn over" given a sufficient meta-analytic procedure given the information available at that point in spacetime? > - "Why would a US President abstain from using ChatGPT or similar to fill > speeches 'just like what I said before'?" > > #Burgundy > - How can we use [ChatGPT] and other Prompt Engineering approaches to perform Evidence-Based Policy with supporting computational analyses prepared in form for meta-analysis given verification of data quality and experimental controls? > > GPT or similar trained on only Formally-Verified code with associated tests > and/or e.g. Lean Mathlib, or e.g. the Principia in SymPy & Cirq; that > could probably eliminate my job, but maybe still not teaching > - "Q: ChatGPT etc. trained on mathlib and tests" https://github.com/leanprover-community/mathlib/issues/17919 - "Port the QuantumQ game to Cirq (SymPy (Python))?" - https://quantumai.google/cirq/start/start - https://colab.research.google.com/drive/11WGNX8TKOmjpmvJWO7v19gXKoEwIwxyw?usp=sharing - "How does [ChatGPT] compare to Critical Thinking, Reasoning, Logic, and Rationality? https://en.wikipedia.org/wiki/Critical_thinking#Logic_and_rationality > On Wed, Jan 4, 2023, 6:28 AM Christian Mascher <christian.masc...@gmx.de> > wrote: > >> Hi, >> >> a student of mine was aware of this chatbot and asked it about a >> class-assignment of his own accord. We program in Java with some extra >> homemade library class used by some schools in our region. >> >> The bot came up with a "solution" which was flawed in several respects: >> 1. It used some other (unimported) classes - solution doesn't work and >> doesn't fit the assignment. >> 2. It put all the code into the constructor, a typical (design and >> style) error for students beginning with Java. >> >> When confronted with the problem number one above, it acknowledged the >> fault and produced a different unrelated solution. >> >> Sooo.... >> >> I was impressed how well the chatbot simulated a typical clueless human >> who even thinks he is smart, while his code is basically bullshit. >> (Probably a result of googling forums, where other learners posted their >> solutions to assignments with the given school library classes.) The bot >> clearly passed the Turing test ;-) >> >> But... >> >> I don't think the interaction was helpful for somebody who is learning >> to program. It is probably less helpful than conversing with other also >> not very knowledgeable students as they are at least reasoning humans. >> >> Talking to the bot might be fun to do in the last lesson before >> christmas or so. Entertaining until you realise the software is >> "simulating" intelligent conversation - not really talking with insight. >> And that could turn out to be a waste of time. >> >> Happy new year >> >> Christian >> >> Am 03.01.2023 um 04:06 schrieb Jurgis Pralgauskis: >> > Hi, happy NY! >> > >> > ChatGPT can create, fix and explain code >> > https://openai.com/blog/chatgpt/#samples >> > <https://openai.com/blog/chatgpt/#samples> >> > >> > Anyone tried to incorporate it into teaching process? >> > Or have ideas/doubts how it ciuld help? >> > >> > _______________________________________________ >> > Edu-sig mailing list -- edu-sig@python.org >> > To unsubscribe send an email to edu-sig-le...@python.org >> > https://mail.python.org/mailman3/lists/edu-sig.python.org/ >> > Member address: christian.masc...@gmx.de >> _______________________________________________ >> Edu-sig mailing list -- edu-sig@python.org >> To unsubscribe send an email to edu-sig-le...@python.org >> https://mail.python.org/mailman3/lists/edu-sig.python.org/ >> Member address: wes.tur...@gmail.com >> >
_______________________________________________ Edu-sig mailing list -- edu-sig@python.org To unsubscribe send an email to edu-sig-le...@python.org https://mail.python.org/mailman3/lists/edu-sig.python.org/ Member address: arch...@mail-archive.com
