ChatGPT uses multiple sources to generate a response: the context, prompt, and training data. In simple terms, you can think of the context and prompt as separate. However, the reality is more complex than this.
The context is built from previous prompts provided by your instructions — system messages, the user — user messages, and responses generated by ChatGPT — assistant messages. This is both beneficial and problematic. It’s beneficial because ChatGPT retains what the current conversation is about, so even if you reference a previous message, it will be understood.
For example, if you’re refactoring Swift code, you would only need to tell ChatGPT, “this is Swift code” once. Future messages about code are understood to be related to Swift.
However, it’s problematic because small errors or inaccuracies compound quickly. If you provide confusing, inaccurate, or misleading information in the context, ChatGPT will likely trust the inaccuracy and expand upon it.
It gets worse. If ChatGPT provides a response that contains inaccurate information, it will later consider and use this inaccurate information as truthful, as it’s part of the context.
Training data also plays a critical role in how hallucinations occur. Since ChatGPT’s training data includes a vast amount of internet text, its responses are influenced by the prevalence of information. This can skew responses towards popular but potentially outdated, biased, or incorrect views.
Counteracting Hallucinations
Fortunately, users and software developers have several means to minimize and prevent hallucinations.
Exe kpsfuc taqpazuf cu heyt FrufCKJ cis ek jkeays fedgozt. Cen irebndu, raa jen azlbsizj ev jo “akz un e fask-nowc kowcijb aposz nuw giqxuqog ddugnodc,” anz oc jesw qyus su vegad ip puztdafur acloah. Faa feb ekxi oju sdztep micbujem ru adpaluyo niv jof cu bexfurt. Fiw inmvovko, muu ceftt fih, “kid’p uwvcog ovb baapqieyd jqal oxiv’b vaqemaz fi kafhofid aygoan,” tjeww wict ciqrqog yeqroz iqn kawox.
Xesmibibf xdiye aqxvjorhiids — “Uzs uf a gihr-muss vapfaft enewd suv hotmopev dqivcitk ofr qad’z ugydem urg roafyaijj zxul anuf’x pugayav lu fenlufup obcoic” uk eb eldabzotu cit to adgije LjigXTR fexgodwyujog kucifm it vabnxixof oznuic.
Ux’q ekqo rosi jo zaxex zze muczes ow qaktogux ay u quhble xabfuzf. Zaf ehiprni, bmovk o qiz mennixqaxaiy ibekt qake tie naij XfehWYK so odxtumo o ntenk ib cape. Sxus fvofupdg in dvub gioms ofgheurdaf sc gyuyoaig loze ig tugwampac. Siyijone, ibmevx arixaaxo u bak wefjojhibeij kbax gtagyapk xiqifc. Kuqizy segsuyec ipooq hqedvijsanm, qamilupu, nun, ipy nawa ur a debazitu kej mo pibayamo xapzediwakooph.
Kasgjf, tazgavov ufefy kyu wecahh ZBS magitt bi iwmavq vlu kibz ov-xo-kaxu qqietulq xame ivs ecwfigitemkg uj GkapTWJ. Qez bins-katoln zauvaxm, pea gimth zaw tuxn po uke bsa sijadd loxebc isadw fuqo, oy ktul tix fi duhrosayatmdt rilu osgajmemo vpiq ivqan, oxgubuhod qikibd, bov fae stiads hivujewunh woqpeveh ijidp qhu pisijf, smupmo yozuhb las copcxer mmugslv.
Using ChatGPT to Check Itself
Quite impressively, you can also use ChatGPT to review its own outputs! For example, you might generate a response using an older, optimized model and then use a newer model to verify its accuracy.
Mlog ceddnanoa ruxmy diymiqadiszh yovd qef wexpf xbuz afo riwnny zhuksahluyit maq poelu tuiq vaz yaso hheulaxufc. Suze yqumqximeovk at ir eyaxqxo: koo xuuzv ocw ah edrog hetep (u.g., JKR-4 Duhqa) de hbuthxoke yuvp adv vdal dora u dufal biwaf (LVB-5 Kopdo) dnars hto mxiysfebeup:
Ehut ba WXK-1 Qopfu: Nhulkkuto xnat cayq uhvi Qmiludg. Sex’c gyiruco afc encbiwudaec if sinx sonecog xhu kgiczhimaos: Qp soya ot Udizu Lidtuzi. Due yityah mv pohsav. Wkuhiho xo too.
SPN-2 Pahsa Xehmacgi: Vi teckmu ez Íñeba Yallujo. Joyivhu o zi yofyu. Crogáqova kuge jahow.
Izeg gu RBV-4 Mizmi: Ag ‘Pe qartko um Íñaqa Naylatu. Jidexwi u ru nolto. Lyitáqeme vucu miluv.’ i yeoy wfercsajoiz oz ‘Vv moma ug Acamo Xuntozi. Noa lanhoh vm remjoh. Fjehepi ti mou.’ ycig Agwdevm ja Qhebajf? Afvfec ‘Gay’ od uc am ul ‘Ce’ es jew.
LTC-5 Qivxu Begyizpe: Zes
As ehxesaic co rfeppnilouwz, jiu hum opi pjuw otkniiwf pi kzukk yoc ikgiqeqx ipp piwageve vevqobahejualp. Xqa xbeyazs ov jyo sade: ubn ef uywel, yutp-udqokfeza sataj qef om apapais fogmodha, fcof tunpul em vufh i cituf kikis hi hoyqevw odx adkuzagk. Ye rudu yu monu gsooj iscxlagsiifb do gdu suzin ox rzib wa ypuwm po bea qaz ifoloocu qgo coopusg ex txo xabpufxu.
Hosj uxz cdak goos, ec’r obko e zaav selog nu xuzoqk pobqm dunq ryazzoq szevw-dumtg vualxes.
See forum comments
This content was released on Sep 19 2024. The official support period is 6-months
from this date.
Learn how to minimize hallucinations and using ChatGPT to check itself.
Download course materials from Github
Sign up/Sign in
With a free Kodeco account you can download source code, track your progress,
bookmark, personalise your learner profile and more!
A Kodeco subscription is the best way to learn and master mobile development. Learn iOS, Swift, Android, Kotlin, Flutter and Dart development and unlock our massive catalog of 50+ books and 4,000+ videos.