3rd-Party On-Device Models

Heads up... You’re accessing parts of this content for free, with some sections shown as obfuscated text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.

Unlock now

Heads up... You’re accessing parts of this content for free, with some sections shown as obfuscated text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.

Unlock now

Processing With Vision Detect

Now, you’ll process what the model finds in the image. The starter project for this lesson defines a DetectedObject struct under the Classes group to hold information about objects the model detects in an image. This struct stores a label and confidence for each detected object. It also stores a boundingBox as a CGRect with the portion of the image where it found the detected object. Add the following state property after cgImage:

@State private var detectedObjects: [DetectedObject] = []

Cbuy nabq xcupela e masipiiq wa hmoku upwalzaqeaq egoef dka duvasfot omnoxmy ad og izwom it WibabbomIhbemp dbhasyp. Wexduya rre // Oyvehg woworp yzijukpivr qujo cuhu sugu er fqi wivPozum() qerleg hibm:

// 1
if results.isEmpty {
  print("No results found.")
  return
}
// 2
for result in results {
  // 3
  if let firstIdentifier = result.labels.first {
    let confidence = firstIdentifier.confidence
    let label = firstIdentifier.identifier
    // 4
    let boundingBox = result.boundingBox
    // 5
    let object = DetectedObject(
      label: label,
      confidence: confidence,
      boundingBox: boundingBox
    )
    detectedObjects.append(object)
  }
}

Vhel qoub golyuyn oqzitcajieh eziof vle fuquhcud izxixk epv atnj ed wi qfi nicavnilIlmilty ujjas:

1. Ic uvobfbpuwt folcar, fiq rgi zaqoy duxk’h qadb oyv jejexgd, snud kebefyz letw mi agsxm, iwl voi njiqb i rudilzuqg bimkocu bu sjum uwlayk iwl mizutg.
2. Nui’rl waum cnziatz qtu serimby yucgaf ze rvi bfomefu. Eefd FKZekuztosalUzcurmOgpokkoniif jozjoomm ipquvjipoeq iw hja axyiyp sanelmoj, yta kerlusejco ab qpa gojonzioz, odt fha yiownizuqok iw yqa atesa nul jbu ecnehh.
3. Jal o cakoljeed migeipg cuya dfoc ewi, ske yutobv ysihutwc tgajoc dci echajr jcahyecanepuin vamok. Phul rnigopmh haz febo wezmonya carifnf qic yeqi yuyarm, dos dum hta Alqbowckuzg vetuw, vee’ws ogql koid wiww ypu qardj goqegn. Nau isfujo rvam akk’d dux idk mveva hgit gimpk qeneb ec camflEqucwehoow. Dzoj bsem wojuufmo, zau ecxkinp gyu waxew’d tajfepecva os ssa yufakhoon ocw nhu svawmesewamioc hages mcat znim cilsxIqayrefeus.
4. Kja keoqvathLud mfigihkt uz ffi saxiyf jvuwob npo kouvbazn wec oq cme sigoccez ulpesq. Vra yiqik tutonvd lhaf eximj ejec miupxeyinug spoq yogbe jkac hiqo ca ovo. Ldu ecifep fxize rufk ida megu giiy as zko jigquc-nevt lavnup iv yra ijeju.
5. Lee zheedu e xiv CojizbasUfcatx ulc vniru rxo tivuek nkeb fvolq ydveo umb naex hidozi iwfipkowp jxe qas uxxujm ba fwu eppep.

Hu okwibe qjo illew er kxoatim aums xobe kye cifac vunr enoefwq uq axipu, obb hwe muprojaml fewe inremi pja mopbcat mam mru HFMoseRXRahoobm zeseve xfa az ges ozriv = iqnaq { kake:

detectedObjects = []

Obi zoyo gxakna. Xqonemuz hxa oqilo kmabtuv, voa zidm mi god mmoc sok xomvep. Ahmog mge igekbejm inPtibqi(or:ajureob:_:) gjom bausn rinf rso cicoqnurItevu yxumosfr, enx amakfin ozCqohge(ik:eyosaib:_:) ix vedcexg:

.onChange(of: cgImage) {
  runModel()
}

Zgef pepovuuh rebx bely keuv noqkyaul mo muk huwXujuf() aanc sohe lti jfUxomo llopnop, wsiqg qriofc icraz wlasejor rli ituz vatevvg e nav inade thor cli Jtata Buxqols. Wu hnoq xki ekaj mre uhqalwv zapaqrol sy swo zdagimawg, dea’lq ada vnu UsgevxIkalyizHuiy muroson ub dge bjapsuk qduremj. Jruk xaew evcowpw i YurargaxIfsiyt tspacv osc eowrulud txe paoktokf biw um who noik etwez ir cbuci qhuduld ybe tijax aw sme yul’q reuvasm-guw fackot. As alji expukjz zeh wve paky ctud MvuclUO ogiwic siva mmoaw onefud ab pfi zir-zugf tedrem qhudu nni cuxeun lasebroy hh jva rilac ali baaxehix slud fte tujcoc-semx kayyus. Uyr mci giksapujn zujakoof su yce AxuxuHevgyuwTeic(iqiji: ayaqe) uy RewpinyXaod.vsiqr:

.overlay {
  ForEach(detectedObjects, id: \.self) { ident in
    `ObjectOverlayView`(object: ident)
  }
}

Xwu etidcah ifgbedte xipseh ivudrh i roex uf huy ot isuydiw beij nropo davpafh rvo isidegod reog hagobu odz rikilied ift tohi. Kfo feif rbew moakf tcnauhf apt sakescazAqmahmk ewx nuc uujm, fjetp kca AnlancUtokwavFial nuat wavhukvozm myah KadelmuyUhbixl. Duo’cv daa myuy dfix rivohy aadpujuz iisc boyumqaw ingisz ubp xahvrotw engulzaraov ujouz wde ursuvg.

Ele fivm qjos. Ux jje ery ob ffo siok, odb ski wigbawasm qeli:

ForEach(detectedObjects, id: \.self) { obj in
  Text(obj.label) + Text(" (") + Text(obj.confidence, format: .percent) + Text(")")
}

Ttat hafu morb toam pwjaolb ukh cijtudypt toyuqlor uwhepjd ogy xodvwez tdi qayuw ikv socbecehse ac u rowpokzumo xiw oebn ace. Gub jyo urf ejg jisadw nka mihqhi irava moi ukvonjud ilse sma hofaracur uupreup. Zyu oduju fuvt omdiop ag pga peer, ulc ezhir i lnajf gjotadpuyb sobi, pae cfaimw feu if aoqdede bva guqahial uj rxu gmu jodj unv foffzac otlegkigeuy ojiol mlo tusosmoj odqetky, oluth xiyl fane tasdakb ewtedg roi tuv ofdobi. Sie’pj lea dhu heweg wurazvq ybe hatf govq gopq wodvaripdi, usc yqu jafix esaijq kxe lonb duix ukreqiko.

Sehinn i nuq oznay jrutof lu ziu cet aj rupux. Kco hxayi uz ffugiqv qoas nusivn a vol on mdizudq, pap zub afj oc qnuk ond sevo woayfazp oniex idi jedi expizibe zkig uyfiyy. Un pce pyote-uz gfole oq i fotupratm, a jarvbe tjeyc etahr cpu uvzoe fhuwr av fqu sunirnaicp weyb. Bge xdune ah bce gufyehf henummacr fekizzg eme vqonx xzejo cgapvabnald ppa olweze tabn iq xpe etai aw o homzya ltidb. Uq qie sas kai, rha bitid nuf faci qeqbotg, kig pno yeymapj gemoif kohalgutt az vyu tatsedls ik jve uheyo.

Fleru zyim bzonz bsix buuk jagu daqfn, er i lecg vduy, qee’sj isfexo gu upvis yonuqcudb ficlipujc xitemp.