Benefits of participating in a mobile app evaluation project

(1)

Benefits of Participating in a Mobile App

Evaluation Project

Alicia Lillich

Kansas Outreach and Technology

Coordinator

A.R. Dykes Library

University of Kansas Medical

Center

John Bramble

Utah Outreach and Research

Enterprise Coordinator

University of Utah Eccles Health

Sciences Library

(2)

Purpose



MCR provided funds for librarians to purchase

apps.



Participants evaluated and shared their experience

with the community.



Indicators: participants benefit and improve

(3)

Participant Requirements



MCR Full Network member



Professional librarian*



Experiment and report on 4 appropriate apps

(4)

Rules for App Selection



Apps must be appropriate for their setting

–

Purposely kept broad



Must cost money

(5)

Year 1



Distributed $650 = 13 x $50

–

10 iTunes

–

3 Google Play

Year 2



Year 2: $950 = 19 x $50

–

15 iTunes

–

4 Google Play

(6)

Evaluation Tool

*

3. BASIC APP INFORMATION (Ty~ "None" if info is oot :tv:til:tble):

.,._

..

_I

,...

....

QI)..OcllldN

_I

app(l"t .... Of

-

·

~~ ... I <•• ...

-~

-lntiOn!IXIOn ptOf'IM!Or'.oal, ~tc..)" ~ ~-,_.

l

Clllel'lpciOn 11:11' I'IIIJH? 0t Wto&l:t

_I

.tc!CirtMI'Orll'lt .tpp? Of. &Nil ror _I

...

WW\IIV\f.lftilir.ll• 09-T tcfJ)I'IOIM I_

totprOCiuc. IUppott.ICf,IKliON

on. Melrt"

_I

(malting or

·-

)

*

4. OPERATING SYSTEM (m:trk :til th:tt:tpply):

0 10•

o

...

0

Ohc (tr« hta"'It. oo. ltoptr'D 1n a 'ftCI!XtM-wr?)

*

5. APP CREDIBILITY (Ty~ "None" if info is not :tv:til3ble)

a..-·

I

~-lrW COf!MfttOIIIIIJpp'

:.::.::._

I

-·

0:. WNIII1hl

,_,_,

[

-...

,

*

6. PURPOSE (Select "nl:t" for question NOT :tpplic:tble to your "PPI

...

,_..,

16atnCIIOIIeae-VIC:f-NOKtpl3:ll::ltl'tlban')'ln901.liNJpp'l~"

Pl'ease add adOII!IMII comtl'!ffttl Nt you ' " ' WCMJIO oe Mrf1M.

*7. BIAS, AUTHORITY, & ACCURACY

Ne mere con&plcuou& polmt.lll, Cl.ftll'<ll, or rtngtou. pttlf>tCIIIvtl prtMnttO? Ale mere ac~vernumentl on tnt app 1

I& thE' p.3geVo<ell wnt:en (no lyp06)! was me app w.ll!leG or peer rtvltwt<l DOf O".httl?

Ye&

0

0 0 0 0

0 0 0

No InfO NOT avanacte

0

..:.1

.:J

*8. CURRENCY: Tell us :tbout the currency of the inforrn:ttion used in this :tpp:

00-.WhM.._h~ OC.~iihellrtl:nnar:-on~cw

-·

. . m'MCI Of upci;Ud? ~ ltlf ll1e app'5 klpie?

j

*9. APP ORGANIZATION (Tell us :~bout the "PPS org,niution):

--·

-·

I

.:J

(7)

Reporting



Summaries of each review highlighted in the

Plains to Peak Post (MCR newsletter)

2016 MCR Questionnaire:

23/28 readers said reports

increased awareness of

mobile apps

(8)

Year One

13 Library Type

Hospital

6 Academic

7 Card Type

iTunes

10 Google Play

3 State

Colorado

3 Kansas

3 Missouri

2 Nebraska

3 Utah

1 Wyoming

1 Participants

Year Two

19 Library Type

Hospital

5 Academic

14 Card Type

iTunes

15 Google Play

4 State

Colorado

3 Kansas

2 Missouri

7 Nebraska

4 Utah

2 Wyoming

1

(9)

Apps Evaluated

Excellent

 1Password

 AnkiMobile

 BioStat Decision Tool

 CalenMob Pro for Google Calendar

 Clear

 Clinical Pattern Recognition: Knee Pain

 Concussion Assessment & Response: Sport Version

 Dexteria - Fine Motor Skills Development

 Duet Display

 Explain Everything

 Family Medicine Study Guide

 Family Practice Notebook

 FRAX:WHO Fracture Risk Assessment Tool

 GoodReader

 IFTTT

 iMoodJournal

 Infectious Disease Compendium: A Persiflager's Guide

 iThoughts

 Kidometer

 KidsDoc

 Medrills: Pediatric considerations

 Micromedex Drug Reference Essentials

 MindNode

 Muscle Trigger Points by Real Bodywork

 NCLEX-RN Alt-format

 Patient Education Bundle

 Patient Education Bundle-Spine

 patient education bundle; Heart

 Patient Education Bundle: Heart, Ortho and Spine

 PDF Expert 5

 Pocket Anatomy

 Pocket Heart, version 2.3

 Prognosis: Your Diagnosis

 Research Methods for Library and

Information Science Professionals - Book by Martin Frické

 Spine Pro III

 SplashID

 Stop Breathe & Think

 The Mindfulness App

 Transesophageal Echocardiography (TEE): Colour Doppler

 Visible Body Atlas

Very Good

 ABCs of Medical Management of Stones

 ArchieMD 3D Health Essentials

 Buddhify

 Byword

 CBT Keeper

 Diagnosaurus DDX

 Differential diagnosis pocket. Also referred to as DDX Pocket

 Drawboard PDF

 Encyclopedia of Alternative Medicine

 English<>Spanish Medical  Evernote  Feed Baby  Flashcards Deluxe  GoScholar  ICU Rounds  iGeriatrics  igeriatrics

 Infectious Disease Compendium: A Persiflager's Guide

 Interfaith Care for the Ill

 JKZ Series2 and JKZ Series3 (Mindfulness Apps by Jon Kabat-Zinn)

 Journal Club for Android

 Lab Values Pro

 Lab Values Pro 3 in 1 Medical Reference

 LastPass Password Mgr Premium

 MD on Call

 MedCalc - The Professional Medical Calculator

 Medical Microbiology Pronunciations

 Medical Spanish: Healthcare Phrasebook with Audio

 Mediquations

 Mediquations Medical Calculator

 Memeo Connect Reader for ipad

 MRSA eGuideline

 My Wonderful Days: Daily Journal/Diary

 NCLEX-RN Exam Prep 2015

 Noteshelf

 Nurse Tabs Complete

 OnExam

 Pediatric Quiz Game

 Physical Exam Essentials

 Pill Monitor – Medication Reminders and Logs

 Prioritize Me

 Prizmo Scanning & OCR app

 Psych On Demand

 PubMed on Tap

 RH Medical Labs

 SoundNote

 The Mindfulness App

 Todo

Fairly/Mildly Good

 AHIMA Pocket Glossary

 Animated Pocket Dictionary of Allergy

 Dara Torres Health & Fitness

 Fooducate

 GoodReader

 Instant Anatomy Flash Cards

 Journal Club for Android

 LabGear 3.0

 Large Print Message Composer

 Lippincott's NCLEX-RN

 Marvin

 Medical Abbreviations

 Medical Doctor: Reference Tool

 Medical Microbiology

 Medical Term Pronunciation

 Medical Terms Abbreviation

 MobileDDx

 mySymptoms

 NCLEX-RN Practice Test & Questions

 Osteopathic Medicine pocketcards By Börm Bruckmeier Publishing LLC

 Outliner

 Pain Therapy

 palmEM

 Pediatric Blue Book

 Polaris Office5

 PSA (Psychological Symptoms Analyzer)

 RN Cheat Sheet  Shelby's Quest  Shelved  SportsMed  TalkBoard  Ultimeyes Not Good

 Everyday First Aid

 Instant Blood Pressure

 Nursing History

(10)

Year 1



Total Spent: $305



Average Cost: $6.63



Highest App Cost: $24



Lowest App Cost: Free



Leftover Funds: $345

Year 2



Total Spent: $625



Average Cost: $8.22



Highest App Cost: $45



Lowest App Cost: Free



Leftover Funds: $325

(11)



Apps mainly focused on

health/medicine or

productivity

0

10

20

30

40

50

60 Health/Medicine

Productivity

Year 1

Year 2

App Types

(12)

App Ranking

0

5

10

15

20

25

30 Excellent

Very Good

Fairly/Mildly Good

Not Good

(13)

Self-Evaluation

[VALUE] 22% 31% 5% 5%

58%

47%

54%

26%

15%

Y2: My involvement in this

project benefited or enhanced

my professional development.

Y2: I now feel more

confident in my ability to

evaluate mobile apps.

Y1: Participating in this project

benefited my program.

Strongly

Agree

Neither

Disagree

No Response

Positively

Very

Positively

(14)

Rate of Participation

73%

74%

21%

26%

6%

Year 1

Year 2

No Report

Late

On Time

(15)



Evaluations were

down-graded for:

–

Blank Responses

–

Using “Information Not

Available” response



Range A (0 deductions) to

G (6 deductions)

Quality of Evaluations

0 5 10 15 20 25 30 35 A B C D E F G

(16)

Lessons Learned - Positives



Fun



Diverse apps were selected

(17)

Participant Comments



“You have made this a fun year!”



“This enabled me to critically evaluate apps that I

otherwise would not have downloaded. I am also

reading all the other reviews and will be adding a

section to our mobile apps LibGuide.”

(18)

Lessons Learned - Challenges



Lower cost app selection



Managing participants

–

Meeting deadlines

–

Quality of evaluations



Evaluation form problems

(19)

Participant Comments



“I found the evaluation form for this project hard

to fill out”



“Sometimes it was difficult to decide which app to

test drive. Lots of information on free apps, but

how do you find apps with a fee that are

(20)

Recommendations



Limit funds



Revise evaluation form

–

Shorten

–

Require responses

(21)