1 00:00:03,510 --> 00:00:04,563 - Thanks, Jennifer. 2 00:00:06,613 --> 00:00:10,350 All right, so it is exactly four o'clock, 3 00:00:10,350 --> 00:00:11,670 so I will go ahead 4 00:00:11,670 --> 00:00:15,060 and get us started to make sure we start on time. 5 00:00:15,060 --> 00:00:17,100 Good afternoon, everyone. 6 00:00:17,100 --> 00:00:20,250 Thank you so much for joining us today. 7 00:00:20,250 --> 00:00:22,140 My name is Frances Barreto. 8 00:00:22,140 --> 00:00:24,870 I am one of the district success managers 9 00:00:24,870 --> 00:00:28,650 that support our amazing partners in Arizona. 10 00:00:28,650 --> 00:00:33,060 And you do have a dedicated team here to support you 11 00:00:33,060 --> 00:00:34,770 as you see on the screen. 12 00:00:34,770 --> 00:00:36,480 That includes Chelsea Hatchard, 13 00:00:36,480 --> 00:00:38,940 who's our district partnership manager, 14 00:00:38,940 --> 00:00:42,930 Sheryl Dossola supports as the rostering specialist. 15 00:00:42,930 --> 00:00:44,370 We have Victoria Cheng, 16 00:00:44,370 --> 00:00:47,430 who is another district success manager, 17 00:00:47,430 --> 00:00:50,280 and then Jennifer Cummings and India Quarles 18 00:00:50,280 --> 00:00:54,150 are your professional learning specialists. 19 00:00:54,150 --> 00:00:57,510 We are especially excited to have Sarah Robertson 20 00:00:57,510 --> 00:01:01,470 from the Khan Academy Writing Coach team with us today, 21 00:01:01,470 --> 00:01:03,210 and she's gonna be sharing 22 00:01:03,210 --> 00:01:06,720 how you can help your students become more confident 23 00:01:06,720 --> 00:01:11,720 and skilled writers using Khanmigo's Writing Coach tool. 24 00:01:11,880 --> 00:01:13,440 This is the first 25 00:01:13,440 --> 00:01:16,260 out of several professional learning opportunities 26 00:01:16,260 --> 00:01:20,610 that you're going to be able to participate in the spring, 27 00:01:20,610 --> 00:01:22,470 so keep an eye out for an email 28 00:01:22,470 --> 00:01:26,250 that should be coming your way March 11th 29 00:01:26,250 --> 00:01:28,350 with the registration links 30 00:01:28,350 --> 00:01:31,440 for our Arizona Spring Learning series. 31 00:01:31,440 --> 00:01:33,330 And remember that if you register, 32 00:01:33,330 --> 00:01:35,340 you'll automatically receive the recording, 33 00:01:35,340 --> 00:01:37,983 even if you can't attend live. 34 00:01:39,570 --> 00:01:42,000 Please feel free to drop any questions 35 00:01:42,000 --> 00:01:45,450 or thoughts in the chat throughout the session. 36 00:01:45,450 --> 00:01:50,450 Jennifer and I will be actively in the chat 37 00:01:51,330 --> 00:01:54,210 and we'll also be sending the recording your way 38 00:01:54,210 --> 00:01:56,490 after this session as well. 39 00:01:56,490 --> 00:01:57,630 So without further ado, 40 00:01:57,630 --> 00:02:00,450 I'm gonna go ahead and pass it on to Sarah. 41 00:02:00,450 --> 00:02:01,957 - Thank you, Frances. - [Frances] You're welcome. 42 00:02:01,957 --> 00:02:06,483 - I'm gonna share my presentation now. 43 00:02:08,820 --> 00:02:11,970 All right, hopefully you can all see 44 00:02:11,970 --> 00:02:14,223 where it says Meet Khanmigo Writing Coach. 45 00:02:15,420 --> 00:02:16,470 Yes, okay, awesome. 46 00:02:16,470 --> 00:02:18,240 I'm gonna try and have the chat open as well 47 00:02:18,240 --> 00:02:20,640 so I can keep an eye on what you all are saying. 48 00:02:21,870 --> 00:02:23,130 Welcome, everyone. 49 00:02:23,130 --> 00:02:25,290 I'm really excited to be here. 50 00:02:25,290 --> 00:02:27,780 A little bit about myself. 51 00:02:27,780 --> 00:02:29,340 My name is Sarah Robertson. 52 00:02:29,340 --> 00:02:32,670 I am a principal product manager here at Khan Academy, 53 00:02:32,670 --> 00:02:35,340 focusing on literacy experiences 54 00:02:35,340 --> 00:02:37,740 and classroom tools to support ELA 55 00:02:37,740 --> 00:02:39,780 and humanities teachers specifically. 56 00:02:39,780 --> 00:02:43,290 And some background of sort of where I came from. 57 00:02:43,290 --> 00:02:46,440 I was a middle school ELA teacher in Boston. 58 00:02:46,440 --> 00:02:48,990 That's a picture of me when I had a lot less gray hair 59 00:02:48,990 --> 00:02:50,013 than I have now. 60 00:02:51,240 --> 00:02:53,670 And when I was a teacher, I taught seventh grade. 61 00:02:53,670 --> 00:02:56,940 Many of my students were significantly below grade level. 62 00:02:56,940 --> 00:02:59,970 I taught a variety of humanities classes 63 00:02:59,970 --> 00:03:01,230 during my time in the classroom, 64 00:03:01,230 --> 00:03:02,700 but the hardest of all the classes 65 00:03:02,700 --> 00:03:04,740 that I taught was writing. 66 00:03:04,740 --> 00:03:06,933 I think as a writing teacher, 67 00:03:07,890 --> 00:03:10,680 I assigned 25 different essays 68 00:03:10,680 --> 00:03:13,560 throughout the course of one single school year. 69 00:03:13,560 --> 00:03:15,780 And like most middle and high school teachers, 70 00:03:15,780 --> 00:03:17,550 I had about 100 students, 71 00:03:17,550 --> 00:03:18,750 maybe more than that, 72 00:03:18,750 --> 00:03:21,990 so that's about 2,500 distinct essay drafts 73 00:03:21,990 --> 00:03:24,540 for me to guide students through producing, 74 00:03:24,540 --> 00:03:28,470 provide timely, detailed, personalized feedback on, 75 00:03:28,470 --> 00:03:31,050 evaluate against a rubric. 76 00:03:31,050 --> 00:03:34,030 I worked easily about 12 hours a day 77 00:03:35,040 --> 00:03:36,270 and nearly every weekend, 78 00:03:36,270 --> 00:03:38,790 and even still, it always felt like I could never get 79 00:03:38,790 --> 00:03:40,170 to all the students in the class 80 00:03:40,170 --> 00:03:41,730 who were asking for my help. 81 00:03:41,730 --> 00:03:43,320 I could never keep a close enough eye 82 00:03:43,320 --> 00:03:45,270 on the students who I knew needed my help, 83 00:03:45,270 --> 00:03:46,650 but weren't asking for it. 84 00:03:46,650 --> 00:03:48,780 I could never deliver personalized feedback 85 00:03:48,780 --> 00:03:49,920 to students quickly enough, 86 00:03:49,920 --> 00:03:51,990 even if I tried really hard. 87 00:03:51,990 --> 00:03:55,500 I never really knew about what my students needed 88 00:03:55,500 --> 00:03:56,640 at any given moment 89 00:03:56,640 --> 00:03:58,980 or how to better support them. 90 00:03:58,980 --> 00:04:00,990 And the burnout from this year 91 00:04:00,990 --> 00:04:04,530 of teaching writing specifically was so real. 92 00:04:04,530 --> 00:04:07,230 And keep in mind this was before COVID, 93 00:04:07,230 --> 00:04:09,300 before learning loss, 94 00:04:09,300 --> 00:04:12,090 and before generative AI, 95 00:04:12,090 --> 00:04:14,157 so I have a lot of empathy for many of you 96 00:04:14,157 --> 00:04:16,560 who are currently in the classroom. 97 00:04:16,560 --> 00:04:21,180 So today I am excited to share with you 98 00:04:21,180 --> 00:04:22,500 the solution that we built 99 00:04:22,500 --> 00:04:25,710 in response to these very real classroom challenges. 100 00:04:25,710 --> 00:04:28,590 So we'll talk a bit about why we built Writing Coach 101 00:04:28,590 --> 00:04:30,720 and our intentions behind its design, 102 00:04:30,720 --> 00:04:33,630 and then I'm gonna dig into how to actually use it 103 00:04:33,630 --> 00:04:36,960 and show you how to find it and how to assign things. 104 00:04:36,960 --> 00:04:39,390 I'll show you what the student experience is like 105 00:04:39,390 --> 00:04:40,350 and what the teacher 106 00:04:40,350 --> 00:04:42,840 and administrator reports are like as well. 107 00:04:42,840 --> 00:04:45,750 And then I will send you off and hopefully you can go 108 00:04:45,750 --> 00:04:47,580 and use it and explore it yourselves. 109 00:04:47,580 --> 00:04:49,020 And then I'll actually give you my email 110 00:04:49,020 --> 00:04:51,263 so you can send me the feedback that you have. 111 00:04:52,140 --> 00:04:55,860 All right, so I had asked if we could make this 112 00:04:55,860 --> 00:04:57,690 a meeting-type webinar 113 00:04:57,690 --> 00:05:00,420 so you all could be a little bit more interactive. 114 00:05:00,420 --> 00:05:01,560 So now we have the chat. 115 00:05:01,560 --> 00:05:03,810 Thank you, Aviv, for setting that up. 116 00:05:03,810 --> 00:05:04,740 I would love for you all 117 00:05:04,740 --> 00:05:06,900 to answer this question in the chat. 118 00:05:06,900 --> 00:05:08,820 I'm wondering if you could just name, 119 00:05:08,820 --> 00:05:11,610 what are some things that you know students need 120 00:05:11,610 --> 00:05:14,913 in order to reach grade-level proficiency in writing? 121 00:05:16,020 --> 00:05:16,890 Take a minute and think 122 00:05:16,890 --> 00:05:18,873 and put your thoughts into the chat. 123 00:05:30,390 --> 00:05:32,700 Kim says, "Vocabulary, sentence fluency, 124 00:05:32,700 --> 00:05:34,830 punctuation, practice 125 00:05:34,830 --> 00:05:37,530 help with sentence structure, grammar, punctuation." 126 00:05:37,530 --> 00:05:38,463 Absolutely. 127 00:05:40,260 --> 00:05:42,750 Format of the writing, yes. 128 00:05:42,750 --> 00:05:45,420 Practice and timely feedback, yes. 129 00:05:45,420 --> 00:05:50,420 I'm seeing a lot of practice, feedback, direct instruction. 130 00:05:50,580 --> 00:05:52,350 Out of curiosity, does anybody know 131 00:05:52,350 --> 00:05:55,590 how much time the National Commission on Writing recommends 132 00:05:55,590 --> 00:05:58,980 that middle and high school students should spend 133 00:05:58,980 --> 00:06:00,870 on writing practice? 134 00:06:00,870 --> 00:06:02,133 Let's say each day. 135 00:06:03,600 --> 00:06:05,130 How many minutes per day do they recommend? 136 00:06:05,130 --> 00:06:06,430 Guess, put it in the chat. 137 00:06:08,340 --> 00:06:09,543 30 minutes. 138 00:06:10,530 --> 00:06:11,363 60 minutes. 139 00:06:11,363 --> 00:06:12,393 30 minutes. 140 00:06:14,040 --> 00:06:16,170 All right, you guys are well informed. 141 00:06:16,170 --> 00:06:17,763 It's 60 minutes per day. 142 00:06:19,470 --> 00:06:20,340 I taught writing, 143 00:06:20,340 --> 00:06:22,470 so in my classroom, 144 00:06:22,470 --> 00:06:23,910 kids were writing a lot of the time 145 00:06:23,910 --> 00:06:27,330 when they weren't watching me model things 146 00:06:27,330 --> 00:06:29,250 or teaching things, 147 00:06:29,250 --> 00:06:30,840 but in many schools, 148 00:06:30,840 --> 00:06:32,940 there isn't a separate writing class 149 00:06:32,940 --> 00:06:36,810 and most students are not actually getting the 60 minutes 150 00:06:36,810 --> 00:06:38,760 of writing practice per day, 151 00:06:38,760 --> 00:06:41,280 as I'm sure you all are well aware. 152 00:06:41,280 --> 00:06:44,580 Other things that I saw mentioned that students need, 153 00:06:44,580 --> 00:06:46,080 they need the direct instruction 154 00:06:46,080 --> 00:06:49,470 specifically in things like the rhetorical situation, 155 00:06:49,470 --> 00:06:51,720 audience, purpose, tone, rhetoric, 156 00:06:51,720 --> 00:06:54,330 text structure, sentence structure, grammar, 157 00:06:54,330 --> 00:06:56,370 the writing process, how we begin to write, 158 00:06:56,370 --> 00:06:59,130 how we think about writing, how to conduct research, 159 00:06:59,130 --> 00:07:01,890 how to incorporate evidence, how to cite evidence. 160 00:07:01,890 --> 00:07:05,340 They also need things like exposure to mentor texts, 161 00:07:05,340 --> 00:07:08,310 they need modeling, they need vocabulary-building practice, 162 00:07:08,310 --> 00:07:09,807 they need feedback 163 00:07:09,807 --> 00:07:12,690 and that feedback has to be specific and actionable 164 00:07:12,690 --> 00:07:15,750 and it also has to be delivered not three weeks 165 00:07:15,750 --> 00:07:18,090 from when they wrote the essay. 166 00:07:18,090 --> 00:07:20,940 And then of course, reading practice and comprehension 167 00:07:20,940 --> 00:07:21,773 is part of that too. 168 00:07:21,773 --> 00:07:24,690 And they also just need to feel motivated, 169 00:07:24,690 --> 00:07:26,373 that's a really big piece. 170 00:07:28,080 --> 00:07:30,660 Again, looking for you all to go to the chat, 171 00:07:30,660 --> 00:07:32,130 what are some of the things 172 00:07:32,130 --> 00:07:36,000 that make teaching writing especially challenging? 173 00:07:36,000 --> 00:07:38,193 Go ahead and put your thoughts in the chat. 174 00:07:41,070 --> 00:07:43,080 Time, yes, for sure. 175 00:07:43,080 --> 00:07:43,913 Yep. 176 00:07:46,230 --> 00:07:47,103 Never enough. 177 00:07:48,390 --> 00:07:49,440 Differentiation. 178 00:07:49,440 --> 00:07:50,313 Yes, Robert. 179 00:07:51,690 --> 00:07:54,870 The feedback piece is, yes, really challenging. 180 00:07:54,870 --> 00:07:56,700 Motivation, yep, yep. 181 00:07:56,700 --> 00:07:58,980 Definitely time for providing that feedback, 182 00:07:58,980 --> 00:08:01,030 especially if you have a lot of students. 183 00:08:02,640 --> 00:08:03,993 Grade-level reading, yep. 184 00:08:04,980 --> 00:08:06,273 Exactly, agree. 185 00:08:07,230 --> 00:08:09,270 Texting all the time. 186 00:08:09,270 --> 00:08:11,553 Yeah, productive struggle, that's a big one. 187 00:08:12,813 --> 00:08:16,050 And I think the motivation piece plays into that too. 188 00:08:16,050 --> 00:08:20,730 So I spend a lot of my time talking to 189 00:08:20,730 --> 00:08:23,040 and learning from ELA teachers, 190 00:08:23,040 --> 00:08:25,140 and writing is consistently one of the hardest parts 191 00:08:25,140 --> 00:08:27,333 of the job as I experienced firsthand. 192 00:08:28,350 --> 00:08:30,540 These are some quotes from interviews 193 00:08:30,540 --> 00:08:32,700 that we've done with ELA teachers 194 00:08:32,700 --> 00:08:35,280 and I also happen to grab some screenshots 195 00:08:35,280 --> 00:08:37,110 from a few of the recent comments 196 00:08:37,110 --> 00:08:40,323 in various ELA teacher Facebook groups that I'm still in. 197 00:08:41,520 --> 00:08:44,400 So yeah, kids are not writing on grade level 198 00:08:44,400 --> 00:08:46,563 and it's really no wonder why. 199 00:08:47,430 --> 00:08:49,170 A big piece of this, as you all mentioned, 200 00:08:49,170 --> 00:08:53,130 is timely, specific, actional feedback is so critical, 201 00:08:53,130 --> 00:08:56,220 but with one teacher to 100-plus students, 202 00:08:56,220 --> 00:08:59,763 it's nearly impossible and teachers are really overwhelmed. 203 00:09:00,930 --> 00:09:03,060 Also, since I've been in the classroom, 204 00:09:03,060 --> 00:09:06,363 which is now, I think, approaching 10 years ago, 205 00:09:07,320 --> 00:09:09,300 it's gotten a lot harder. 206 00:09:09,300 --> 00:09:11,640 My husband is a writing professor, 207 00:09:11,640 --> 00:09:13,680 he teaches college freshmen, 208 00:09:13,680 --> 00:09:15,600 so I hear from his perspective a lot 209 00:09:15,600 --> 00:09:19,680 about how student AI use has affected writing instruction 210 00:09:19,680 --> 00:09:21,720 and practice in his classroom. 211 00:09:21,720 --> 00:09:25,080 I also hear this from many of the teachers that I speak to 212 00:09:25,080 --> 00:09:25,950 through Khan Academy 213 00:09:25,950 --> 00:09:27,540 and I expect that some of you might have had 214 00:09:27,540 --> 00:09:29,790 some personal experience dealing with this too. 215 00:09:29,790 --> 00:09:32,883 And there are various things out there. 216 00:09:34,200 --> 00:09:35,167 Somebody here mentions, 217 00:09:35,167 --> 00:09:37,590 "I've seen several AI checkers online recently. 218 00:09:37,590 --> 00:09:39,330 How accurate are those?" 219 00:09:39,330 --> 00:09:40,260 They're not, 220 00:09:40,260 --> 00:09:43,020 they're not accurate, unfortunately. 221 00:09:43,020 --> 00:09:44,040 We all wish that there was 222 00:09:44,040 --> 00:09:47,370 like one beautiful magical solution to this problem, 223 00:09:47,370 --> 00:09:49,020 but it has been really challenging 224 00:09:49,020 --> 00:09:51,867 for teachers to be able to spot students 225 00:09:51,867 --> 00:09:54,180 who are using this technology. 226 00:09:54,180 --> 00:09:56,640 And it can be, as I'm sure you know, 227 00:09:56,640 --> 00:09:58,350 very difficult to challenge a student 228 00:09:58,350 --> 00:10:01,980 who you think has produced something with ChatGPT, 229 00:10:01,980 --> 00:10:04,233 but you don't have the evidence for that. 230 00:10:05,940 --> 00:10:08,130 Okay, for this one, 231 00:10:08,130 --> 00:10:11,433 I wanted to touch upon another prescient question. 232 00:10:12,300 --> 00:10:15,480 About a year ago I led a workshop with high school students 233 00:10:15,480 --> 00:10:17,310 on AI and writing 234 00:10:17,310 --> 00:10:19,200 and one of the students said to me, 235 00:10:19,200 --> 00:10:21,600 and this was like a very precocious, 236 00:10:21,600 --> 00:10:23,610 I don't know, 14-year-old girl, 237 00:10:23,610 --> 00:10:25,320 she said, "I just don't see the point 238 00:10:25,320 --> 00:10:27,000 in learning to write anymore, 239 00:10:27,000 --> 00:10:28,110 AI can do it for me. 240 00:10:28,110 --> 00:10:30,090 Why do I need to learn to do this thing 241 00:10:30,090 --> 00:10:32,340 that AI can just do for me?" 242 00:10:32,340 --> 00:10:34,110 And I want you to take a minute 243 00:10:34,110 --> 00:10:35,460 and you can answer in the chat, 244 00:10:35,460 --> 00:10:36,660 or if you feel so inclined, 245 00:10:36,660 --> 00:10:40,110 you can come off mute and just say it out loud, 246 00:10:40,110 --> 00:10:41,700 do you agree or disagree? 247 00:10:41,700 --> 00:10:43,830 Do you think that it's still important? 248 00:10:43,830 --> 00:10:45,540 I feel like this is probably a biased group, 249 00:10:45,540 --> 00:10:48,930 but do you think it's important to still learn to write, 250 00:10:48,930 --> 00:10:51,060 for students to still learn to write, and why? 251 00:10:51,060 --> 00:10:53,250 What would you say to that student? 252 00:10:53,250 --> 00:10:54,630 So yes, I'm gonna pause here, 253 00:10:54,630 --> 00:10:55,860 and if you have something to say, 254 00:10:55,860 --> 00:10:58,733 feel free to come off mute and just say or put it in chat. 255 00:11:01,110 --> 00:11:04,083 - Hi Sarah, this is Johna Wallace. 256 00:11:05,820 --> 00:11:07,500 I'm gonna say this out loud, 257 00:11:07,500 --> 00:11:11,610 I think that students do need to learn how to write. 258 00:11:11,610 --> 00:11:15,120 My son works in finance 259 00:11:15,120 --> 00:11:20,120 and he has to be able to communicate to other people 260 00:11:20,850 --> 00:11:23,160 what he has done with his clients, 261 00:11:23,160 --> 00:11:25,920 and if he cannot write coherently, 262 00:11:25,920 --> 00:11:28,200 that communication is not there. 263 00:11:28,200 --> 00:11:29,490 Also with the writing, 264 00:11:29,490 --> 00:11:32,460 it helps clarify students' thinking 265 00:11:32,460 --> 00:11:35,640 and their ability to communicate with one another, 266 00:11:35,640 --> 00:11:37,773 so they need to know how to do that. 267 00:11:39,420 --> 00:11:40,253 - 100%. 268 00:11:40,253 --> 00:11:41,373 You said it so perfectly. 269 00:11:42,390 --> 00:11:43,260 Everything you said. 270 00:11:43,260 --> 00:11:44,580 Writing is thinking, 271 00:11:44,580 --> 00:11:46,320 writing is communicating. 272 00:11:46,320 --> 00:11:48,690 Without knowing how to write, 273 00:11:48,690 --> 00:11:50,850 we can't actually sometimes process 274 00:11:50,850 --> 00:11:53,130 what we even think about something. 275 00:11:53,130 --> 00:11:55,830 We don't have that critical muscle, 276 00:11:55,830 --> 00:11:57,210 we're not building that critical muscle 277 00:11:57,210 --> 00:12:00,090 of processing information and working through information 278 00:12:00,090 --> 00:12:01,530 and communicating it in ways 279 00:12:01,530 --> 00:12:04,950 that reflect our own personal experiences 280 00:12:04,950 --> 00:12:06,123 and our own beliefs. 281 00:12:06,990 --> 00:12:11,040 I came across this Joan Didion quote a while ago 282 00:12:11,040 --> 00:12:14,400 and it sort of gave me exactly 283 00:12:14,400 --> 00:12:16,230 what I think I was trying to convey 284 00:12:16,230 --> 00:12:19,740 when I was presented with these kinds of opinions 285 00:12:19,740 --> 00:12:21,030 from various people, 286 00:12:21,030 --> 00:12:22,230 specifically students who were like, 287 00:12:22,230 --> 00:12:24,030 why do I need to do this anymore? 288 00:12:24,030 --> 00:12:25,087 And Joan Didion says, 289 00:12:25,087 --> 00:12:28,590 "I write entirely to find out what I'm thinking, 290 00:12:28,590 --> 00:12:30,033 what I'm looking at, 291 00:12:31,050 --> 00:12:33,330 what I see and what it means." 292 00:12:33,330 --> 00:12:35,490 And I get chills when I say that every time 293 00:12:35,490 --> 00:12:37,950 because as somebody who, 294 00:12:37,950 --> 00:12:40,590 I consider myself a writer and a writing teacher 295 00:12:40,590 --> 00:12:42,510 and somebody who supports writing teachers now, 296 00:12:42,510 --> 00:12:47,070 and writing is so much more than the written content, right? 297 00:12:47,070 --> 00:12:47,910 It's not, 298 00:12:47,910 --> 00:12:50,460 the process of writing means something 299 00:12:50,460 --> 00:12:51,630 and it's important 300 00:12:51,630 --> 00:12:53,940 and it has real human value. 301 00:12:53,940 --> 00:12:55,680 And I think as teachers, 302 00:12:55,680 --> 00:12:58,650 it's our jobs not just to teach students how to write, 303 00:12:58,650 --> 00:13:00,180 but to teach them about 304 00:13:00,180 --> 00:13:03,603 why they still should be learning to write, right? 305 00:13:05,970 --> 00:13:09,360 There's also a robust body of evidence that shows 306 00:13:09,360 --> 00:13:10,530 that there are real cognitive 307 00:13:10,530 --> 00:13:12,480 and psychological benefits from writing. 308 00:13:12,480 --> 00:13:15,360 It helps students, again, process emotions, 309 00:13:15,360 --> 00:13:16,320 process their thinking, 310 00:13:16,320 --> 00:13:17,460 figure out what they feel, 311 00:13:17,460 --> 00:13:18,870 figure out what they believe. 312 00:13:18,870 --> 00:13:22,890 It's a really wonderful tool 313 00:13:22,890 --> 00:13:25,593 that we all have in our toolbox as human beings. 314 00:13:27,150 --> 00:13:28,620 So I agree, 315 00:13:28,620 --> 00:13:31,860 I don't think that large language models or AI 316 00:13:31,860 --> 00:13:34,560 is a reason that we should not teach writing anymore. 317 00:13:34,560 --> 00:13:36,810 I don't think anybody would be surprised by that. 318 00:13:36,810 --> 00:13:40,110 And if anything, I actually think it's more important now 319 00:13:40,110 --> 00:13:41,523 than it has ever been, 320 00:13:42,480 --> 00:13:45,270 but it is still very critical 321 00:13:45,270 --> 00:13:48,540 to educate students about AI and large language models 322 00:13:48,540 --> 00:13:51,180 and to use it ethically and responsibly in the classroom. 323 00:13:51,180 --> 00:13:54,030 And we could do an entire webinar 324 00:13:54,030 --> 00:13:57,240 specifically on this topic of effective 325 00:13:57,240 --> 00:13:59,010 and ethical AI use in classrooms alone, 326 00:13:59,010 --> 00:14:03,030 but I sort of jotted down a list of some of the things 327 00:14:03,030 --> 00:14:06,363 to consider when we are incorporating AI in the classroom. 328 00:14:08,460 --> 00:14:09,960 The first thing is, 329 00:14:09,960 --> 00:14:13,560 is the use of this AI actually helping students learn 330 00:14:13,560 --> 00:14:16,200 or are we using it as a shortcut? 331 00:14:16,200 --> 00:14:19,020 Will students become reliant on the AI? 332 00:14:19,020 --> 00:14:21,930 And if it's being used as some sort of scaffolding, 333 00:14:21,930 --> 00:14:25,950 how can we gradually remove that scaffolding over time? 334 00:14:25,950 --> 00:14:27,660 Do students understand 335 00:14:27,660 --> 00:14:31,230 how the content from the AI is actually being generated? 336 00:14:31,230 --> 00:14:32,523 Where it comes from, 337 00:14:33,360 --> 00:14:36,420 when to trust it, when definitely not to trust it, 338 00:14:36,420 --> 00:14:39,240 when to say something about the fact 339 00:14:39,240 --> 00:14:41,460 that they might have used it in some way. 340 00:14:41,460 --> 00:14:43,620 And are they using AI in ways 341 00:14:43,620 --> 00:14:47,190 that allow them to focus more of their efforts 342 00:14:47,190 --> 00:14:49,110 on higher-order thinking skills 343 00:14:49,110 --> 00:14:52,053 and also on the human element of writing too? 344 00:14:53,670 --> 00:14:58,140 There are many opinions on these topics, 345 00:14:58,140 --> 00:15:03,140 but I do believe that there are many ways 346 00:15:03,810 --> 00:15:08,810 in which even if we use AI for things like brainstorming, 347 00:15:09,030 --> 00:15:10,620 I think it depends on the situation, 348 00:15:10,620 --> 00:15:12,810 but in some ways some might argue 349 00:15:12,810 --> 00:15:14,400 that that's actually taking away 350 00:15:14,400 --> 00:15:17,610 some of the really important thinking skills 351 00:15:17,610 --> 00:15:19,140 that students do when they brainstorm. 352 00:15:19,140 --> 00:15:21,720 It doesn't hurt maybe to have somebody 353 00:15:21,720 --> 00:15:26,160 to bounce ideas off of or to jumpstart things, 354 00:15:26,160 --> 00:15:29,760 but worlds in which AI generates a first draft 355 00:15:29,760 --> 00:15:32,160 or AI generates a list of ideas, 356 00:15:32,160 --> 00:15:34,920 we should just be thinking about what is the AI doing 357 00:15:34,920 --> 00:15:37,170 that a student previously could have been doing, 358 00:15:37,170 --> 00:15:41,043 and are we taking something away of value to that student? 359 00:15:42,390 --> 00:15:43,830 Okay. 360 00:15:43,830 --> 00:15:45,690 So with all of that in mind, 361 00:15:45,690 --> 00:15:49,590 let's learn about how and why we made Writing Coach 362 00:15:49,590 --> 00:15:51,840 and then I'm going to show you how to use it. 363 00:15:53,310 --> 00:15:56,580 Khan Academy is a well-known company. 364 00:15:56,580 --> 00:16:01,170 It is not necessarily as well-known for writing and reading 365 00:16:01,170 --> 00:16:04,200 and ELA or humanities as it is for STEM, 366 00:16:04,200 --> 00:16:06,330 but our mission has always been 367 00:16:06,330 --> 00:16:08,520 to provide a free world-class education 368 00:16:08,520 --> 00:16:10,470 to anyone and anywhere, 369 00:16:10,470 --> 00:16:12,450 and we've always wanted to provide 370 00:16:12,450 --> 00:16:15,180 that same level of support in the humanities. 371 00:16:15,180 --> 00:16:18,540 So when large language models became broadly available 372 00:16:18,540 --> 00:16:20,280 in late 2022, 373 00:16:20,280 --> 00:16:22,710 we immediately began exploring ways 374 00:16:22,710 --> 00:16:24,300 that we could leverage the technology 375 00:16:24,300 --> 00:16:26,100 to achieve that mission. 376 00:16:26,100 --> 00:16:29,340 And it's probably no surprise that we found LLMs 377 00:16:29,340 --> 00:16:32,910 to be especially helpful in the writing space specifically. 378 00:16:32,910 --> 00:16:35,310 So like all great products, 379 00:16:35,310 --> 00:16:38,100 Writing Coach was also designed 380 00:16:38,100 --> 00:16:41,580 as a solution to some very real problems. 381 00:16:41,580 --> 00:16:44,580 So what we know about writing 382 00:16:44,580 --> 00:16:46,770 is that, of course, students are expected 383 00:16:46,770 --> 00:16:48,960 to meet grade-level standards. 384 00:16:48,960 --> 00:16:52,440 They need to be writing 60 minutes per day. 385 00:16:52,440 --> 00:16:53,430 They need support, 386 00:16:53,430 --> 00:16:56,550 not just at the end of the writing process 387 00:16:56,550 --> 00:16:58,590 when they've produced a draft and they need feedback, 388 00:16:58,590 --> 00:17:01,020 but they actually need help getting started, 389 00:17:01,020 --> 00:17:03,360 they need help outlining, they need help drafting, 390 00:17:03,360 --> 00:17:04,460 and they need to learn 391 00:17:05,370 --> 00:17:08,190 how to do those different parts of the process. 392 00:17:08,190 --> 00:17:09,780 And then, of course, as we all mentioned, 393 00:17:09,780 --> 00:17:12,090 they need specific, actionable, 394 00:17:12,090 --> 00:17:16,923 personalized, timely feedback in order to improve. 395 00:17:18,060 --> 00:17:23,060 But in reality, only about a quarter of secondary students 396 00:17:23,430 --> 00:17:25,470 meet grade-level writing standards. 397 00:17:25,470 --> 00:17:28,680 The vast majority of students are not clocking even close 398 00:17:28,680 --> 00:17:31,950 to their recommended hour of practice a day. 399 00:17:31,950 --> 00:17:34,260 Most teachers have way more students 400 00:17:34,260 --> 00:17:38,160 than they can give personalized writing process support to. 401 00:17:38,160 --> 00:17:41,130 And I mention this math set all the time. 402 00:17:41,130 --> 00:17:43,530 If the average teacher has 100 students 403 00:17:43,530 --> 00:17:48,120 and limits herself to 10 minutes of feedback per essay, 404 00:17:48,120 --> 00:17:49,470 which is something I would do, 405 00:17:49,470 --> 00:17:52,770 I would set my timer 10 minutes per essay, 406 00:17:52,770 --> 00:17:57,570 that's 17 hours for one draft of one assignment 407 00:17:57,570 --> 00:18:00,630 for me to give feedback to every kid, 408 00:18:00,630 --> 00:18:02,640 17 hours for one assignment. 409 00:18:02,640 --> 00:18:05,580 And if kids are writing an hour a day, 410 00:18:05,580 --> 00:18:07,110 I just don't, 411 00:18:07,110 --> 00:18:08,400 the math isn't mathing, 412 00:18:08,400 --> 00:18:10,230 as the kids say these days, 413 00:18:10,230 --> 00:18:12,450 it's just not really possible. 414 00:18:12,450 --> 00:18:16,500 So in 2023, we started working on a solution 415 00:18:16,500 --> 00:18:19,620 and then last fall we launched Writing Coach 416 00:18:19,620 --> 00:18:21,573 to our school and district partners. 417 00:18:22,860 --> 00:18:25,260 And when I talk about Writing Coach, 418 00:18:25,260 --> 00:18:28,410 I think oftentimes people hear AI, writing, 419 00:18:28,410 --> 00:18:30,000 and they sort of have a picture in their head 420 00:18:30,000 --> 00:18:30,930 of what this is. 421 00:18:30,930 --> 00:18:34,740 So I like to kind of explain what it is 422 00:18:34,740 --> 00:18:36,250 against what it's not 423 00:18:37,620 --> 00:18:39,990 and how it's different from some of the other things 424 00:18:39,990 --> 00:18:41,970 that people might be familiar with. 425 00:18:41,970 --> 00:18:44,460 So you might be familiar with tools, 426 00:18:44,460 --> 00:18:46,260 for example, like Grammarly. 427 00:18:46,260 --> 00:18:47,093 I use Grammarly, 428 00:18:47,093 --> 00:18:47,926 Grammarly is great. 429 00:18:47,926 --> 00:18:51,210 Grammarly gives AI-generated feedback to students, 430 00:18:51,210 --> 00:18:53,070 but it typically provides more sentence 431 00:18:53,070 --> 00:18:54,600 or phrase-level suggestions 432 00:18:54,600 --> 00:18:57,270 and allows them to click a button and accept the suggestion 433 00:18:57,270 --> 00:18:59,590 without really having to figure out 434 00:19:00,630 --> 00:19:02,760 how to change it themselves. 435 00:19:02,760 --> 00:19:04,980 You might be familiar with other tools 436 00:19:04,980 --> 00:19:08,250 who can kind of generate feedback quickly 437 00:19:08,250 --> 00:19:12,990 for the teacher using AI or even for the students. 438 00:19:12,990 --> 00:19:15,240 Some of these things are paid, some are free, 439 00:19:15,240 --> 00:19:18,690 but usually the feedback is rather limited, 440 00:19:18,690 --> 00:19:20,130 there's not that much feedback, 441 00:19:20,130 --> 00:19:22,440 or the teacher gets the feedback, 442 00:19:22,440 --> 00:19:25,200 but then has to figure out how to get it to the student. 443 00:19:25,200 --> 00:19:28,590 And to this day, I haven't really found anybody else 444 00:19:28,590 --> 00:19:32,340 who guides students through the actual writing process 445 00:19:32,340 --> 00:19:35,610 stage by stage in the way that we do. 446 00:19:35,610 --> 00:19:37,830 And if you're familiar with ChatGPT, 447 00:19:37,830 --> 00:19:40,140 which I'm assuming all of you are, 448 00:19:40,140 --> 00:19:41,970 it's obviously always more than happy 449 00:19:41,970 --> 00:19:43,890 to just rewrite a student's essay for them 450 00:19:43,890 --> 00:19:45,870 or produce it from scratch. 451 00:19:45,870 --> 00:19:47,640 And there's positive use cases 452 00:19:47,640 --> 00:19:50,130 for all of these different kinds of tools, 453 00:19:50,130 --> 00:19:52,020 but the primary purpose behind them 454 00:19:52,020 --> 00:19:57,020 is usually either to save time or to produce better writing, 455 00:19:58,560 --> 00:20:00,930 not to produce better writers. 456 00:20:00,930 --> 00:20:03,270 And that is really how Writing Coach is different. 457 00:20:03,270 --> 00:20:06,960 The intention behind Writing Coach is to help teachers 458 00:20:06,960 --> 00:20:11,160 create better writers and not just better writing. 459 00:20:11,160 --> 00:20:14,220 So it is an instructional tool 460 00:20:14,220 --> 00:20:16,500 with the primary purpose of student learning 461 00:20:16,500 --> 00:20:18,750 and teacher transparency. 462 00:20:18,750 --> 00:20:20,550 It's a tool designed to guide students 463 00:20:20,550 --> 00:20:22,410 through the full essay-writing process 464 00:20:22,410 --> 00:20:24,000 while preventing cheating. 465 00:20:24,000 --> 00:20:25,590 It's a way for teachers to give students 466 00:20:25,590 --> 00:20:29,010 more writing practice and real-time support. 467 00:20:29,010 --> 00:20:31,560 And we have data dashboards for teachers 468 00:20:31,560 --> 00:20:34,740 that have at-a-glance and in-depth insights 469 00:20:34,740 --> 00:20:36,570 into their students' writing processes. 470 00:20:36,570 --> 00:20:39,570 So it's not just a digital essay-writing platform, 471 00:20:39,570 --> 00:20:42,960 it's not something that grades or evaluate student writing, 472 00:20:42,960 --> 00:20:44,610 it gives feedback, it doesn't score, 473 00:20:44,610 --> 00:20:45,930 and that's really on purpose 474 00:20:45,930 --> 00:20:48,180 because I could talk about this for a long time, 475 00:20:48,180 --> 00:20:50,310 but I think if we're telling students 476 00:20:50,310 --> 00:20:52,050 that their voices matter, 477 00:20:52,050 --> 00:20:54,480 we should have a human reading what they have to say 478 00:20:54,480 --> 00:20:55,313 at some point. 479 00:20:56,400 --> 00:20:58,260 It's not a student productivity tool, 480 00:20:58,260 --> 00:20:59,940 it's not a feedback generator, 481 00:20:59,940 --> 00:21:01,680 and it's not a tool that provides 482 00:21:01,680 --> 00:21:04,260 easy-to-accept suggestions 483 00:21:04,260 --> 00:21:06,660 for improving things like grammar and mechanics. 484 00:21:08,070 --> 00:21:09,660 So just really quick, 485 00:21:09,660 --> 00:21:14,100 we launched Writing Coach now about six months ago or so 486 00:21:14,100 --> 00:21:16,050 and the feedback that we've gotten 487 00:21:16,050 --> 00:21:18,090 has been very, very positive 488 00:21:18,090 --> 00:21:20,760 from the teachers and the students who have used it so far. 489 00:21:20,760 --> 00:21:24,030 We had one teacher talk about how the feedback 490 00:21:24,030 --> 00:21:28,170 that Khanmigo generated was very, very close 491 00:21:28,170 --> 00:21:30,780 to what they would have written themselves 492 00:21:30,780 --> 00:21:31,790 on student writing. 493 00:21:31,790 --> 00:21:35,310 In some cases it was more detailed or more specific. 494 00:21:35,310 --> 00:21:38,610 Another teacher said that they used this 495 00:21:38,610 --> 00:21:41,370 for an IB essay prep course 496 00:21:41,370 --> 00:21:44,370 and they had seen this make the biggest difference 497 00:21:44,370 --> 00:21:46,710 in helping students with that essay 498 00:21:46,710 --> 00:21:49,290 than any any tool they've ever used. 499 00:21:49,290 --> 00:21:53,190 We had one teacher in a district who used this consistently 500 00:21:53,190 --> 00:21:56,400 and her class had every single student pass 501 00:21:56,400 --> 00:21:57,900 that state writing assessment. 502 00:21:58,800 --> 00:22:00,533 And so we were really excited about what this is 503 00:22:00,533 --> 00:22:01,440 and how it works. 504 00:22:01,440 --> 00:22:04,233 So let's just dive into what it looks like. 505 00:22:05,910 --> 00:22:09,720 Okay, so the first step in using Writing Coach 506 00:22:09,720 --> 00:22:11,430 is to create a Writing Coach assignment, 507 00:22:11,430 --> 00:22:14,820 and a Writing Coach assignment is an essay assignment. 508 00:22:14,820 --> 00:22:19,820 To begin, you should start by logging in to Khan Academy. 509 00:22:19,950 --> 00:22:21,570 So you can access Writing Coach 510 00:22:21,570 --> 00:22:22,830 directly through Khan Academy. 511 00:22:22,830 --> 00:22:26,460 As you can see here in the top of every Khan Academy screen, 512 00:22:26,460 --> 00:22:28,830 you see a Khanmigo drop-down 513 00:22:28,830 --> 00:22:31,530 and you can click on Writing Coach and get there that way. 514 00:22:31,530 --> 00:22:34,140 And if you're logged in to a Khan Academy account, 515 00:22:34,140 --> 00:22:35,880 you'll be logged in to a Writing Coach account, 516 00:22:35,880 --> 00:22:37,620 Writing Coach is part of Khan Academy, 517 00:22:37,620 --> 00:22:41,140 but you can also just go to khanmigo.ai/writingcoach 518 00:22:42,030 --> 00:22:45,690 and that will also take you directly to Writing Coach. 519 00:22:45,690 --> 00:22:48,420 Once you are in Writing Coach as a teacher, 520 00:22:48,420 --> 00:22:51,390 you will see three tabs on the left, 521 00:22:51,390 --> 00:22:52,710 one says Assignments, 522 00:22:52,710 --> 00:22:54,120 one says My Essays, 523 00:22:54,120 --> 00:22:56,310 and one says About Writing Coach. 524 00:22:56,310 --> 00:22:58,230 Assignments, self-explanatory, 525 00:22:58,230 --> 00:23:00,720 that is where you create assignments for students. 526 00:23:00,720 --> 00:23:04,020 The My Essays space is kind of like a playground for you 527 00:23:04,020 --> 00:23:08,130 to play around with sample essays that we've created. 528 00:23:08,130 --> 00:23:11,280 You can test out or demo essays 529 00:23:11,280 --> 00:23:12,870 that you might have assigned to your students 530 00:23:12,870 --> 00:23:15,390 so that you can model 531 00:23:15,390 --> 00:23:17,910 how to use it for the first time with them. 532 00:23:17,910 --> 00:23:20,250 But to access your assignments and create assignments, 533 00:23:20,250 --> 00:23:23,280 you would do that from your Assignments tab. 534 00:23:23,280 --> 00:23:24,450 And you just should be looking 535 00:23:24,450 --> 00:23:25,920 for this Create Assignment button 536 00:23:25,920 --> 00:23:27,470 in the top right of the screen. 537 00:23:30,180 --> 00:23:34,080 So a Writing Coach essay assignment starts with a prompt 538 00:23:34,080 --> 00:23:37,740 and it should be a prompt that you are providing. 539 00:23:37,740 --> 00:23:39,990 The essay instructions, I can't emphasize this enough, 540 00:23:39,990 --> 00:23:41,880 are the most important part. 541 00:23:41,880 --> 00:23:44,100 The more details you include, 542 00:23:44,100 --> 00:23:48,728 the more of a stickler Khanmigo will be when, they, 543 00:23:48,728 --> 00:23:53,700 Khanmigo is guiding students through the writing process. 544 00:23:53,700 --> 00:23:57,690 So if you say things like, 545 00:23:57,690 --> 00:23:59,460 make sure in your instructions, 546 00:23:59,460 --> 00:24:02,370 make sure you include three pieces of textual evidence, 547 00:24:02,370 --> 00:24:04,680 Khanmigo will take that information 548 00:24:04,680 --> 00:24:07,530 and check that the student has that amount of evidence 549 00:24:07,530 --> 00:24:09,570 whenever it's giving feedback. 550 00:24:09,570 --> 00:24:13,140 If you say you need to use MLA in-text citations 551 00:24:13,140 --> 00:24:15,030 or APA in-text citations, 552 00:24:15,030 --> 00:24:18,840 Khanmigo will check to make sure that students did that. 553 00:24:18,840 --> 00:24:21,120 If you say that they need to have 554 00:24:21,120 --> 00:24:23,760 a concession/rebuttal paragraph 555 00:24:23,760 --> 00:24:24,870 in their argumentative essay, 556 00:24:24,870 --> 00:24:27,090 again, Khanmigo will have that context 557 00:24:27,090 --> 00:24:30,210 and then make sure students are meeting those requirements. 558 00:24:30,210 --> 00:24:33,090 Also, if you are doing an essay 559 00:24:33,090 --> 00:24:35,880 that is in order to prep students for the ACT 560 00:24:35,880 --> 00:24:39,090 or another test, an AP test or something, 561 00:24:39,090 --> 00:24:42,060 you can say in the instruction specifically, 562 00:24:42,060 --> 00:24:43,680 this is an AP practice test 563 00:24:43,680 --> 00:24:46,350 or this is an ACT practice essay, 564 00:24:46,350 --> 00:24:48,900 and that also helps Khanmigo understand, 565 00:24:48,900 --> 00:24:53,340 okay, now I have all of the information in the world 566 00:24:53,340 --> 00:24:54,960 about what makes a great ACT essay 567 00:24:54,960 --> 00:24:58,257 and I know what an exemplary ACT essay looks like 568 00:24:58,257 --> 00:24:59,850 and I know what the rubric looks like. 569 00:24:59,850 --> 00:25:02,610 Just telling Khanmigo this is an ACT essay, 570 00:25:02,610 --> 00:25:05,100 Khanmigo will take that context 571 00:25:05,100 --> 00:25:07,683 and tailor its interactions accordingly. 572 00:25:08,640 --> 00:25:10,020 One thing I do wanna point out, 573 00:25:10,020 --> 00:25:13,320 'cause this is a common source of confusion, 574 00:25:13,320 --> 00:25:16,350 the grade level drop-down here, 575 00:25:16,350 --> 00:25:20,820 you can select any grade level you want. 576 00:25:20,820 --> 00:25:22,560 Right now we have fifth/sixth, 577 00:25:22,560 --> 00:25:24,180 which is kind of like a beta level 578 00:25:24,180 --> 00:25:26,400 because it will still be a little bit advanced. 579 00:25:26,400 --> 00:25:29,133 And then we have the seventh all the way through 12th. 580 00:25:30,180 --> 00:25:32,670 We use this to get Khanmigo 581 00:25:32,670 --> 00:25:34,890 to tailor the language that it's using 582 00:25:34,890 --> 00:25:35,910 when it's chatting with students, 583 00:25:35,910 --> 00:25:38,520 but also to tailor the feedback that it gives. 584 00:25:38,520 --> 00:25:41,193 So if you select fifth/sixth, 585 00:25:42,030 --> 00:25:47,030 it might give less feedback or less harsh feedback 586 00:25:47,130 --> 00:25:50,283 than if you select 12th grade for the same essay. 587 00:25:51,150 --> 00:25:53,040 And that's, again, in order to make sure 588 00:25:53,040 --> 00:25:56,130 that Khanmigo is leveling itself appropriately. 589 00:25:56,130 --> 00:25:58,950 Students will not see the grade level that you select. 590 00:25:58,950 --> 00:26:01,890 So if you teach 11th graders 591 00:26:01,890 --> 00:26:03,900 and it's the beginning of the year 592 00:26:03,900 --> 00:26:05,850 and you're kind of building things up, 593 00:26:05,850 --> 00:26:08,190 you can select seventh grade as their level 594 00:26:08,190 --> 00:26:09,780 if you really want the feedback 595 00:26:09,780 --> 00:26:14,760 to be a little bit more just broken down 596 00:26:14,760 --> 00:26:16,170 or to kind of build them up 597 00:26:16,170 --> 00:26:19,470 to the higher grade levels of feedback throughout the year. 598 00:26:19,470 --> 00:26:21,570 So that's a scaffolding tool that I like to mention 599 00:26:21,570 --> 00:26:23,520 because it's not always clear. 600 00:26:23,520 --> 00:26:24,930 Students won't see the grade level, 601 00:26:24,930 --> 00:26:26,520 so they're not gonna feel demoralized 602 00:26:26,520 --> 00:26:28,380 if you choose a level that's below 603 00:26:28,380 --> 00:26:29,880 the level they're actually in. 604 00:26:33,630 --> 00:26:35,370 Another thing I like to tell people. 605 00:26:35,370 --> 00:26:38,580 So when you are designing your essay instructions, 606 00:26:38,580 --> 00:26:40,143 again, for the assignment, 607 00:26:41,730 --> 00:26:46,730 things that you can use are details from the actual rubrics 608 00:26:46,890 --> 00:26:49,200 that you will be using or that are relevant. 609 00:26:49,200 --> 00:26:51,660 So for example, if you're preparing students 610 00:26:51,660 --> 00:26:54,930 for the Arizona six through eight argumentative essay, 611 00:26:54,930 --> 00:26:55,950 you're assigning something, 612 00:26:55,950 --> 00:27:00,120 you can use former released essay prompts, for example. 613 00:27:00,120 --> 00:27:03,450 One thing you can do in your essay instructions is to say, 614 00:27:03,450 --> 00:27:06,090 this is a writing practice test 615 00:27:06,090 --> 00:27:09,120 for the ASA seventh grade essay. 616 00:27:09,120 --> 00:27:11,910 Students will be evaluated on purpose, 617 00:27:11,910 --> 00:27:13,230 focus and organization, 618 00:27:13,230 --> 00:27:15,150 evidence and elaboration, conventions. 619 00:27:15,150 --> 00:27:19,560 And you can even say things from that score four, 620 00:27:19,560 --> 00:27:21,390 so you can literally copy and paste. 621 00:27:21,390 --> 00:27:25,920 The response should have a strongly maintained claim 622 00:27:25,920 --> 00:27:27,153 with little or no, 623 00:27:28,380 --> 00:27:29,520 wait, yeah, 624 00:27:29,520 --> 00:27:30,810 loosely related material. 625 00:27:30,810 --> 00:27:32,760 So you're pulling the exact information 626 00:27:32,760 --> 00:27:33,840 from that score four. 627 00:27:33,840 --> 00:27:36,840 So that means that when Khanmigo is helping the student 628 00:27:36,840 --> 00:27:38,640 through the essay writing, 629 00:27:38,640 --> 00:27:40,860 drafting and revising and all of that, 630 00:27:40,860 --> 00:27:44,340 it will have that in mind that those are the expectations 631 00:27:44,340 --> 00:27:45,840 that will make this a great essay. 632 00:27:45,840 --> 00:27:48,720 So if you wanna get more information in there, 633 00:27:48,720 --> 00:27:50,940 that's usually always very helpful 634 00:27:50,940 --> 00:27:54,750 to make sure that Khanmigo is preparing students 635 00:27:54,750 --> 00:27:56,970 for the essay. 636 00:27:56,970 --> 00:27:59,550 No, you cannot upload the rubric yet, 637 00:27:59,550 --> 00:28:01,890 that is something that we are hoping to do, 638 00:28:01,890 --> 00:28:05,880 but instead you can copy and paste details 639 00:28:05,880 --> 00:28:07,110 from this part of the rubric. 640 00:28:07,110 --> 00:28:09,390 Again, you really only need to tell it 641 00:28:09,390 --> 00:28:12,183 this is what you would need to do to get a four. 642 00:28:13,200 --> 00:28:14,460 You don't need to provide the rest of it 643 00:28:14,460 --> 00:28:17,130 because, again, this isn't an evaluative tool, 644 00:28:17,130 --> 00:28:18,330 it's not gonna score students, 645 00:28:18,330 --> 00:28:19,773 so it's really about giving them feedback 646 00:28:19,773 --> 00:28:22,503 that will help them get the highest score possible. 647 00:28:24,450 --> 00:28:27,090 And then for ACT, I think I remember, 648 00:28:27,090 --> 00:28:28,260 am I remembering correctly 649 00:28:28,260 --> 00:28:30,393 that high schools in Arizona use the ACT? 650 00:28:31,230 --> 00:28:32,850 Okay. 651 00:28:32,850 --> 00:28:34,860 You don't have to do that level of detail, 652 00:28:34,860 --> 00:28:37,800 you can just say this is an ACT practice essay 653 00:28:37,800 --> 00:28:40,530 because Khanmigo knows ACT practice essay 654 00:28:40,530 --> 00:28:44,040 and knows what a great ACT practice essay looks like, 655 00:28:44,040 --> 00:28:45,810 it knows what will get you the highest score, 656 00:28:45,810 --> 00:28:47,820 and it will make sure that it's giving you feedback 657 00:28:47,820 --> 00:28:49,260 and tailoring directions 658 00:28:49,260 --> 00:28:51,933 according to those expectations for ACT. 659 00:28:54,870 --> 00:28:57,153 So once you have created your assignment, 660 00:28:58,500 --> 00:29:01,560 I think the only other details we ask for are due date 661 00:29:01,560 --> 00:29:03,840 and then you can create a class if you haven't yet 662 00:29:03,840 --> 00:29:07,140 or assign it to a class you already have on Khan Academy. 663 00:29:07,140 --> 00:29:09,000 Your students can access it 664 00:29:09,000 --> 00:29:11,970 from their Khan Academy main dashboard 665 00:29:11,970 --> 00:29:15,120 or they can go directly to Writing Coach themselves. 666 00:29:15,120 --> 00:29:16,500 You'll also, when you create your assignment, 667 00:29:16,500 --> 00:29:19,080 you'll see a link that you can share with them, 668 00:29:19,080 --> 00:29:21,060 you can put it in Google Classroom or Canvas 669 00:29:21,060 --> 00:29:21,893 or whatever you use, 670 00:29:21,893 --> 00:29:24,510 and they can go straight to the assignment. 671 00:29:24,510 --> 00:29:27,270 Students can also go to khanmigo.ai/writingcoach 672 00:29:27,270 --> 00:29:30,540 and log in to their Khan Academy account from there. 673 00:29:30,540 --> 00:29:32,250 But they should be able to access their assignment 674 00:29:32,250 --> 00:29:34,870 directly in Writing Coach or from Khan Academy 675 00:29:35,790 --> 00:29:37,800 or from the link that you share. 676 00:29:37,800 --> 00:29:41,520 So let's walk through what this looks like for students. 677 00:29:41,520 --> 00:29:42,780 On the left here, 678 00:29:42,780 --> 00:29:44,910 students will see the assignment details 679 00:29:44,910 --> 00:29:48,180 that you provided in the essay instructions field 680 00:29:48,180 --> 00:29:50,400 when you were creating the assignment. 681 00:29:50,400 --> 00:29:54,150 And so they'll see the title of the essay, 682 00:29:54,150 --> 00:29:56,610 they will see the type of essay that you selected, 683 00:29:56,610 --> 00:29:59,700 and right now we support argumentative, persuasive, 684 00:29:59,700 --> 00:30:02,703 expository, explanatory, and literary analysis. 685 00:30:03,540 --> 00:30:07,710 And then we also will be adding soon 686 00:30:07,710 --> 00:30:11,160 AP Language and Composition and SAT. 687 00:30:11,160 --> 00:30:12,780 We don't have an ACT one yet, 688 00:30:12,780 --> 00:30:15,510 but again, you can just choose persuasive, argumentative, 689 00:30:15,510 --> 00:30:16,740 or anything relevant, 690 00:30:16,740 --> 00:30:20,520 and then you can specifically say it's an ACT essay 691 00:30:20,520 --> 00:30:21,520 in the instructions. 692 00:30:22,440 --> 00:30:24,060 And then students see the essay prompt 693 00:30:24,060 --> 00:30:26,040 and instructions that you provided 694 00:30:26,040 --> 00:30:28,530 and then they have Khanmigo on the side. 695 00:30:28,530 --> 00:30:29,880 So for understanding, 696 00:30:29,880 --> 00:30:32,310 it's really just about breaking down the prompt, 697 00:30:32,310 --> 00:30:34,500 making sure the student understands the requirements, 698 00:30:34,500 --> 00:30:36,090 making sure they can ask questions 699 00:30:36,090 --> 00:30:38,580 about anything that they don't get that you put in there. 700 00:30:38,580 --> 00:30:40,890 So they can do things like ask Khanmigo 701 00:30:40,890 --> 00:30:44,040 to define specific terms or break things down, 702 00:30:44,040 --> 00:30:47,220 or even if you provided a lot of information, 703 00:30:47,220 --> 00:30:48,870 it can kind of help them search through that 704 00:30:48,870 --> 00:30:50,940 to kind of find specific answers to their questions. 705 00:30:50,940 --> 00:30:52,860 And they can come back to this at any point. 706 00:30:52,860 --> 00:30:54,540 So if at any point they're like, 707 00:30:54,540 --> 00:30:55,560 what were those directions again, 708 00:30:55,560 --> 00:30:58,920 they can come back to this and ask questions, 709 00:30:58,920 --> 00:31:01,290 but they can also access these instructions 710 00:31:01,290 --> 00:31:03,963 throughout the whole rest of the writing process. 711 00:31:07,890 --> 00:31:08,723 Okay. 712 00:31:09,750 --> 00:31:12,990 When students are ready to get started, 713 00:31:12,990 --> 00:31:15,690 and some additional information 714 00:31:15,690 --> 00:31:17,460 that I don't think I mentioned earlier 715 00:31:17,460 --> 00:31:19,920 is that if in cases where the essay requires 716 00:31:19,920 --> 00:31:21,210 that students do readings 717 00:31:21,210 --> 00:31:23,100 or they have like the source packet 718 00:31:23,100 --> 00:31:24,480 or they have a text 719 00:31:24,480 --> 00:31:27,720 that they are supposed to be gathering evidence from, 720 00:31:27,720 --> 00:31:30,330 that is something that they can either do that 721 00:31:30,330 --> 00:31:33,030 before they start their Writing Coach assignment 722 00:31:33,030 --> 00:31:36,930 or they can do it between understanding and outlining. 723 00:31:36,930 --> 00:31:38,490 Outlining works best, 724 00:31:38,490 --> 00:31:39,960 I mean, it can actually help them 725 00:31:39,960 --> 00:31:42,480 with making sure they're selecting relevant evidence, 726 00:31:42,480 --> 00:31:44,910 but it works best if they've already read the text 727 00:31:44,910 --> 00:31:45,743 or they've already looked at the text 728 00:31:45,743 --> 00:31:47,640 and they're familiar with the topic. 729 00:31:47,640 --> 00:31:49,080 And during the understanding phase, 730 00:31:49,080 --> 00:31:51,063 Khanmigo will kind of nudge them to figure out, 731 00:31:51,063 --> 00:31:53,010 have you read the text yet? 732 00:31:53,010 --> 00:31:54,090 Do you need to go back? 733 00:31:54,090 --> 00:31:56,340 And it will kind of give them advice for what to do next 734 00:31:56,340 --> 00:31:57,843 before they start outlining. 735 00:31:58,860 --> 00:32:01,080 But when students are ready to get started, 736 00:32:01,080 --> 00:32:04,233 this is the basic outline template, 737 00:32:05,460 --> 00:32:07,530 probably looks relatively familiar. 738 00:32:07,530 --> 00:32:11,490 It starts out as a basic kind of five-paragraph essay, 739 00:32:11,490 --> 00:32:12,870 but we made it flexible 740 00:32:12,870 --> 00:32:15,000 so that students can remove paragraphs, 741 00:32:15,000 --> 00:32:17,160 they can add additional paragraphs, 742 00:32:17,160 --> 00:32:20,010 they can do things like add additional evidence 743 00:32:20,010 --> 00:32:21,000 or reasoning, 744 00:32:21,000 --> 00:32:23,640 they can add or remove the source fields, 745 00:32:23,640 --> 00:32:27,840 they can add, 746 00:32:27,840 --> 00:32:29,580 I think we have, yeah, reasoning explanation, 747 00:32:29,580 --> 00:32:31,590 I might have mentioned that, 748 00:32:31,590 --> 00:32:33,930 and move paragraphs around. 749 00:32:33,930 --> 00:32:36,450 So we tried to design it so that it would support 750 00:32:36,450 --> 00:32:38,910 many different kinds of academic essays. 751 00:32:38,910 --> 00:32:42,330 Even if you have a one-paragraph essay, 752 00:32:42,330 --> 00:32:44,280 an extended open response, 753 00:32:44,280 --> 00:32:45,690 it will work that way as well 754 00:32:45,690 --> 00:32:48,090 as long as you're clear in the essay instructions 755 00:32:48,090 --> 00:32:50,853 about the format of what you want students to do. 756 00:32:52,350 --> 00:32:55,110 For each of the outline templates, 757 00:32:55,110 --> 00:32:59,943 we also provide some pretty simple exemplar sentences 758 00:33:01,170 --> 00:33:02,580 for each of the fields. 759 00:33:02,580 --> 00:33:06,270 So if you chose persuasive or argumentative, 760 00:33:06,270 --> 00:33:09,300 we will have an example thesis 761 00:33:09,300 --> 00:33:12,930 related to from like a persuasive or argumentative essay 762 00:33:12,930 --> 00:33:14,190 of a completely different topic. 763 00:33:14,190 --> 00:33:15,630 They're all Khan Academy-related, 764 00:33:15,630 --> 00:33:18,750 so I don't think we have any risk of picking the same topic 765 00:33:18,750 --> 00:33:21,150 as you would choose for your students. 766 00:33:21,150 --> 00:33:23,730 But then Khanmigo, again, is on the side 767 00:33:23,730 --> 00:33:26,990 and Khanmigo can help students get started. 768 00:33:26,990 --> 00:33:29,040 If the student gets started and is stuck, 769 00:33:29,040 --> 00:33:30,600 it's there to help them with that, 770 00:33:30,600 --> 00:33:32,250 Khanmigo can see their outline, 771 00:33:32,250 --> 00:33:33,390 it can check the outline 772 00:33:33,390 --> 00:33:35,610 against the assignment instructions, 773 00:33:35,610 --> 00:33:37,860 again, that the teacher has provided. 774 00:33:37,860 --> 00:33:39,690 So if the student doesn't know what to do next, 775 00:33:39,690 --> 00:33:41,130 Khanmigo will offer some suggestions, 776 00:33:41,130 --> 00:33:44,040 but Khanmigo will never ever provide 777 00:33:44,040 --> 00:33:45,150 something for the student 778 00:33:45,150 --> 00:33:46,980 to actually put into their outline. 779 00:33:46,980 --> 00:33:48,870 So Khanmigo is not gonna give them evidence, 780 00:33:48,870 --> 00:33:51,810 it's not going to write a thesis statement for them, 781 00:33:51,810 --> 00:33:55,410 it's not going to provide examples or main points 782 00:33:55,410 --> 00:33:56,430 or any of that, 783 00:33:56,430 --> 00:33:57,900 it will look at what the student has 784 00:33:57,900 --> 00:34:00,480 and it will give the student advice and tips 785 00:34:00,480 --> 00:34:03,960 and guidance for how they can make progress 786 00:34:03,960 --> 00:34:05,860 and what they're supposed to be doing. 787 00:34:07,770 --> 00:34:10,710 It can also, 788 00:34:10,710 --> 00:34:11,543 oh yes, 789 00:34:11,543 --> 00:34:14,580 when the student is finished outlining, 790 00:34:14,580 --> 00:34:17,070 one of the other kind of interesting things about this 791 00:34:17,070 --> 00:34:18,990 is you might have some students 792 00:34:18,990 --> 00:34:20,910 who just don't really wanna talk to Khanmigo 793 00:34:20,910 --> 00:34:24,000 or they don't really feel like chatting 794 00:34:24,000 --> 00:34:26,310 or they don't really know how to chat. 795 00:34:26,310 --> 00:34:28,560 Even if you never talk to Khanmigo, 796 00:34:28,560 --> 00:34:32,310 when the student moves from outlining to drafting, 797 00:34:32,310 --> 00:34:34,140 we check it anyway. 798 00:34:34,140 --> 00:34:37,740 So we have Khanmigo, again, look at the outline 799 00:34:37,740 --> 00:34:39,810 and look at the assignment instructions, 800 00:34:39,810 --> 00:34:40,860 and at this step, 801 00:34:40,860 --> 00:34:44,730 we're really just checking for pretty high-level basic, 802 00:34:44,730 --> 00:34:46,740 not like, is this a well crafted essay? 803 00:34:46,740 --> 00:34:48,600 It's like, does it have a thesis statement? 804 00:34:48,600 --> 00:34:50,760 And is the thesis statement actually related 805 00:34:50,760 --> 00:34:52,593 to what the essay prompt is asking? 806 00:34:53,460 --> 00:34:55,500 Does the student have enough evidence 807 00:34:55,500 --> 00:34:57,600 according to what the teacher asked for? 808 00:34:57,600 --> 00:35:02,340 Does it have main points that actually support 809 00:35:02,340 --> 00:35:04,740 or could reasonably support the thesis? 810 00:35:04,740 --> 00:35:06,120 I sometimes had seventh graders 811 00:35:06,120 --> 00:35:10,620 who would start with a thesis on one side of an argument, 812 00:35:10,620 --> 00:35:12,420 and then halfway through, they'd switch sides 813 00:35:12,420 --> 00:35:14,430 and wouldn't even realize that they did that. 814 00:35:14,430 --> 00:35:16,500 So that's one of the things that we check for. 815 00:35:16,500 --> 00:35:19,500 And again, if you ask for something like a counterargument 816 00:35:19,500 --> 00:35:20,640 in your instructions, 817 00:35:20,640 --> 00:35:21,930 we'll check for that here. 818 00:35:21,930 --> 00:35:23,910 And if the student has not met 819 00:35:23,910 --> 00:35:25,920 those very basic requirements, 820 00:35:25,920 --> 00:35:28,530 there will be kind of a stopping point where we say, 821 00:35:28,530 --> 00:35:30,270 it looks like your teacher asked for this 822 00:35:30,270 --> 00:35:32,880 and you didn't quite do this part, 823 00:35:32,880 --> 00:35:34,200 so it will let them go back 824 00:35:34,200 --> 00:35:36,840 and they can fix what they didn't do correctly 825 00:35:36,840 --> 00:35:39,813 and then they will move on to drafting at that point. 826 00:35:42,300 --> 00:35:43,680 During the drafting phase, 827 00:35:43,680 --> 00:35:45,150 we try to keep it pretty simple, 828 00:35:45,150 --> 00:35:47,400 we don't want it to be too much distraction. 829 00:35:47,400 --> 00:35:50,700 So again, the student can access the assignment instructions 830 00:35:50,700 --> 00:35:51,630 whenever they need to. 831 00:35:51,630 --> 00:35:55,620 They can also access the outline that they just wrote 832 00:35:55,620 --> 00:35:56,730 from the previous step, 833 00:35:56,730 --> 00:35:57,870 and from that outline, 834 00:35:57,870 --> 00:36:00,840 they can copy and paste the different contents 835 00:36:00,840 --> 00:36:02,190 of their essay that they worked on. 836 00:36:02,190 --> 00:36:04,080 They can take a piece of evidence and put that in 837 00:36:04,080 --> 00:36:06,300 or their thesis statement, et cetera. 838 00:36:06,300 --> 00:36:08,280 They can also just hide this completely 839 00:36:08,280 --> 00:36:11,910 and just have a nice blank drafting area if they want. 840 00:36:11,910 --> 00:36:13,920 But they can chat with Khanmigo if they want to. 841 00:36:13,920 --> 00:36:16,470 And again, Khanmigo in the drafting phase 842 00:36:16,470 --> 00:36:19,680 is going to focus on helping the student get their words 843 00:36:19,680 --> 00:36:21,120 on the paper, 844 00:36:21,120 --> 00:36:23,640 looking at their outline at the appropriate points, 845 00:36:23,640 --> 00:36:24,840 and pulling the information 846 00:36:24,840 --> 00:36:27,750 that the student has already written out in their outline 847 00:36:27,750 --> 00:36:30,990 and helping them kind of begin to craft their arguments 848 00:36:30,990 --> 00:36:33,810 and their points and their prose. 849 00:36:33,810 --> 00:36:37,590 It's not necessarily going to be giving a lot of feedback 850 00:36:37,590 --> 00:36:39,150 at this point because, again, 851 00:36:39,150 --> 00:36:40,650 the drafting phase is really about 852 00:36:40,650 --> 00:36:42,000 get your words on the paper, 853 00:36:42,000 --> 00:36:43,020 get your thoughts on the paper, 854 00:36:43,020 --> 00:36:44,670 get your ideas on the paper, 855 00:36:44,670 --> 00:36:47,130 and then the revising stage will come next. 856 00:36:47,130 --> 00:36:49,440 So Khanmigo at this point is just helping students 857 00:36:49,440 --> 00:36:51,750 get a first draft together 858 00:36:51,750 --> 00:36:55,950 and not too much focusing on the perfection, 859 00:36:55,950 --> 00:36:58,590 trying to make sure every word is perfect. 860 00:36:58,590 --> 00:37:01,080 And again, Khanmigo won't write for them. 861 00:37:01,080 --> 00:37:04,800 You can see here the student might ask them to, 862 00:37:04,800 --> 00:37:06,330 they might ask them to nicely, 863 00:37:06,330 --> 00:37:09,460 and Khanmigo will gently, politely decline 864 00:37:10,440 --> 00:37:12,120 and help them kind of work 865 00:37:12,120 --> 00:37:14,153 through whatever it is they're struggling with. 866 00:37:15,750 --> 00:37:18,573 So when the student has their first draft, 867 00:37:19,680 --> 00:37:24,060 they will at that point move on to the revising stage. 868 00:37:24,060 --> 00:37:26,520 And in revising, the first thing that happens 869 00:37:26,520 --> 00:37:29,970 is Khanmigo will generate feedback in five categories, 870 00:37:29,970 --> 00:37:32,103 which you can see up here. 871 00:37:33,390 --> 00:37:35,880 Introduction and claim is the first one, 872 00:37:35,880 --> 00:37:37,440 then we have evidence and reasoning, 873 00:37:37,440 --> 00:37:39,690 and then there's structure and organization, 874 00:37:39,690 --> 00:37:42,480 conclusion, and style and tone. 875 00:37:42,480 --> 00:37:44,220 Note that in Writing Coach, 876 00:37:44,220 --> 00:37:46,250 Khanmigo will give students feedback 877 00:37:46,250 --> 00:37:47,790 in all of the same areas 878 00:37:47,790 --> 00:37:51,600 as the AASA and ACT writing rubrics, 879 00:37:51,600 --> 00:37:53,940 but it might be categorized slightly differently. 880 00:37:53,940 --> 00:37:58,940 So for this grade six through eight AASA essays 881 00:37:59,040 --> 00:37:59,873 for example, 882 00:37:59,873 --> 00:38:02,970 feedback related to purpose, focus, and organization 883 00:38:02,970 --> 00:38:06,060 that would fall under either introduction or structure. 884 00:38:06,060 --> 00:38:07,590 Evidence and elaboration feedback 885 00:38:07,590 --> 00:38:09,450 would fall under evidence and reasoning. 886 00:38:09,450 --> 00:38:12,750 Conventions would fall under style and tone, et cetera. 887 00:38:12,750 --> 00:38:13,863 And then same for SAT. 888 00:38:14,790 --> 00:38:16,650 Feedback related to development and support 889 00:38:16,650 --> 00:38:17,910 would be under evidence and reasoning, 890 00:38:17,910 --> 00:38:20,160 organization would be under structure, et cetera. 891 00:38:20,160 --> 00:38:21,390 So that the labels are different, 892 00:38:21,390 --> 00:38:23,403 but the feedback is the same. 893 00:38:24,330 --> 00:38:26,610 But I think one of the most important things to know 894 00:38:26,610 --> 00:38:30,360 about the revising stage of Writing Coach 895 00:38:30,360 --> 00:38:32,400 is that it's not just about the feedback. 896 00:38:32,400 --> 00:38:35,070 So of course, in this example, 897 00:38:35,070 --> 00:38:37,170 the student has 20 suggestions 898 00:38:37,170 --> 00:38:40,560 under each of these five categories total 899 00:38:40,560 --> 00:38:43,323 and we let them kind of focus on one area at a time, 900 00:38:44,340 --> 00:38:46,890 but we don't just give them the feedback 901 00:38:46,890 --> 00:38:51,630 and then say, good luck, hope you do well, 902 00:38:51,630 --> 00:38:53,760 we built in revising tools. 903 00:38:53,760 --> 00:38:58,320 So we give, at some point, praise or positive feedback, 904 00:38:58,320 --> 00:39:01,440 but for the critical feedback and the suggestions, 905 00:39:01,440 --> 00:39:05,340 there are actual actionable steps that students can take 906 00:39:05,340 --> 00:39:08,910 to make the changes on the draft right there on the page 907 00:39:08,910 --> 00:39:11,700 or ask Khanmigo for follow-up guidance or support. 908 00:39:11,700 --> 00:39:15,780 So some of the things that students can do are ask Khanmigo 909 00:39:15,780 --> 00:39:17,430 to give them an example, 910 00:39:17,430 --> 00:39:20,040 and this is, I think, one of the most popular things 911 00:39:20,040 --> 00:39:21,090 a student would choose to do. 912 00:39:21,090 --> 00:39:22,620 So if Khanmigo says 913 00:39:22,620 --> 00:39:26,730 your introduction doesn't have enough context 914 00:39:26,730 --> 00:39:27,660 for the reader, 915 00:39:27,660 --> 00:39:29,640 that's, I think, for a very common piece of feedback 916 00:39:29,640 --> 00:39:30,780 for introduction, 917 00:39:30,780 --> 00:39:32,790 the student can say, give me an example, 918 00:39:32,790 --> 00:39:34,980 and Khanmigo will take an essay 919 00:39:34,980 --> 00:39:36,780 on a completely different topic 920 00:39:36,780 --> 00:39:38,130 and then give them an example 921 00:39:38,130 --> 00:39:40,500 of what it looks like not to have context 922 00:39:40,500 --> 00:39:42,330 and then it would look like to have that context, 923 00:39:42,330 --> 00:39:45,480 and that we have seen has been really, really valuable 924 00:39:45,480 --> 00:39:47,340 for students who get a piece of feedback 925 00:39:47,340 --> 00:39:49,593 and they're just like, I don't get it. 926 00:39:50,580 --> 00:39:52,470 So that's very, very helpful. 927 00:39:52,470 --> 00:39:54,180 Then we have explain suggestion, 928 00:39:54,180 --> 00:39:55,410 and that's really helpful. 929 00:39:55,410 --> 00:39:57,450 If Khanmigo is being a little bit wordy, 930 00:39:57,450 --> 00:39:58,890 they can ask it to explain it 931 00:39:58,890 --> 00:40:02,250 and that'll usually result in Khanmigo breaking it down. 932 00:40:02,250 --> 00:40:05,670 If students are struggling readers, 933 00:40:05,670 --> 00:40:08,400 you can also have them say 934 00:40:08,400 --> 00:40:09,330 after they've explained it, 935 00:40:09,330 --> 00:40:11,790 you say, make it simpler, say it simpler, 936 00:40:11,790 --> 00:40:14,640 just keep kind of pushing Khanmigo if they need to. 937 00:40:14,640 --> 00:40:17,250 Students can just ask a general question as well. 938 00:40:17,250 --> 00:40:18,270 But then if they go in 939 00:40:18,270 --> 00:40:21,570 and they change their essay based on the feedback, 940 00:40:21,570 --> 00:40:24,210 they can then immediately just say, check my revision, 941 00:40:24,210 --> 00:40:26,400 and Khanmigo will look at that piece of feedback 942 00:40:26,400 --> 00:40:28,200 and at the change the student just made 943 00:40:28,200 --> 00:40:30,090 and let them know if they've fixed it, 944 00:40:30,090 --> 00:40:32,970 let them know if they've addressed it or not, 945 00:40:32,970 --> 00:40:34,740 and then Khanmigo will say, 946 00:40:34,740 --> 00:40:36,000 you made a little bit of an improvement, 947 00:40:36,000 --> 00:40:38,190 but you could still make it clear 948 00:40:38,190 --> 00:40:39,600 or you can still kind of provide 949 00:40:39,600 --> 00:40:40,860 a little bit more information here 950 00:40:40,860 --> 00:40:43,350 or give them whatever follow-up guidance is necessary 951 00:40:43,350 --> 00:40:45,453 until the student has what they need. 952 00:40:47,520 --> 00:40:49,530 And what else? 953 00:40:49,530 --> 00:40:51,480 They also have access to their outline again 954 00:40:51,480 --> 00:40:52,683 during revising. 955 00:40:53,730 --> 00:40:55,890 And as they are working through their feedback, 956 00:40:55,890 --> 00:40:57,510 they can mark them as resolved 957 00:40:57,510 --> 00:41:01,650 and keep track of where they're at in their revision stage. 958 00:41:01,650 --> 00:41:02,520 As their teacher, 959 00:41:02,520 --> 00:41:03,750 and you'll see this in a minute, 960 00:41:03,750 --> 00:41:06,090 you can see how much feedback they got 961 00:41:06,090 --> 00:41:07,320 and how much they've resolved, 962 00:41:07,320 --> 00:41:10,140 so you can keep track of how close they are 963 00:41:10,140 --> 00:41:12,840 to being done with this second draft. 964 00:41:12,840 --> 00:41:15,360 And when they are finished, 965 00:41:15,360 --> 00:41:18,510 the student can click mark as complete 966 00:41:18,510 --> 00:41:20,520 and that's to let you know that they're done 967 00:41:20,520 --> 00:41:22,560 and happy with their draft. 968 00:41:22,560 --> 00:41:24,750 And they get the option of exporting it, 969 00:41:24,750 --> 00:41:28,410 so they can export it to Microsoft Word or PDF 970 00:41:28,410 --> 00:41:31,020 or even save it as a Google doc. 971 00:41:31,020 --> 00:41:35,220 One other thing to note is that we don't currently support 972 00:41:35,220 --> 00:41:37,140 a work cited page. 973 00:41:37,140 --> 00:41:39,450 Usually for test prep, that's not a concern, 974 00:41:39,450 --> 00:41:42,660 but for longer research essays or whatever, 975 00:41:42,660 --> 00:41:45,030 if you want students to include work cited, 976 00:41:45,030 --> 00:41:48,990 I would have them do that after they've exported it to a doc 977 00:41:48,990 --> 00:41:50,490 or a Google doc, 978 00:41:50,490 --> 00:41:51,750 they can add the work cited there 979 00:41:51,750 --> 00:41:54,390 because this isn't built to kind of support feedback 980 00:41:54,390 --> 00:41:56,970 on that end page. 981 00:41:56,970 --> 00:41:59,940 You can have students provide in-text citations 982 00:41:59,940 --> 00:42:02,850 and it will give them feedback on the in-text citations, 983 00:42:02,850 --> 00:42:06,333 just not the work cited page or the bibliography. 984 00:42:08,220 --> 00:42:11,883 All right, let's look at the teacher report. 985 00:42:13,260 --> 00:42:17,250 So this is the class report for an assignment. 986 00:42:17,250 --> 00:42:20,700 So if you created a persuasive essay assignment 987 00:42:20,700 --> 00:42:22,140 for a given class, 988 00:42:22,140 --> 00:42:24,510 from your Assignments page in your Writing Coach dashboard, 989 00:42:24,510 --> 00:42:27,540 you can click on that and you can see this report. 990 00:42:27,540 --> 00:42:31,290 We designed this report to be a way for you, as a teacher, 991 00:42:31,290 --> 00:42:34,350 to get an at-a-glance view of where students are 992 00:42:34,350 --> 00:42:37,410 and where you might want to dig in 993 00:42:37,410 --> 00:42:39,930 to pay a little bit more close attention 994 00:42:39,930 --> 00:42:42,660 to what happened with a specific student's essay. 995 00:42:42,660 --> 00:42:45,480 So the information that we show you here 996 00:42:45,480 --> 00:42:48,690 is the step of the process that the student is in. 997 00:42:48,690 --> 00:42:51,000 So it'll tell you if a student hasn't started yet, 998 00:42:51,000 --> 00:42:53,850 if they are in the understanding phase or outlining, 999 00:42:53,850 --> 00:42:56,730 if they're drafting or revising or if they're completed. 1000 00:42:56,730 --> 00:42:59,100 We also have little flags 1001 00:42:59,100 --> 00:43:02,040 that will tell you the student is completed, 1002 00:43:02,040 --> 00:43:05,370 but they edited their essay after the due date came, 1003 00:43:05,370 --> 00:43:07,140 so you might wanna just see 1004 00:43:07,140 --> 00:43:09,240 how much they actually did by the due date 1005 00:43:11,190 --> 00:43:14,220 if you have some procrastinators, 1006 00:43:14,220 --> 00:43:17,160 or if students have past due date assignments, 1007 00:43:17,160 --> 00:43:18,570 you can see that as well. 1008 00:43:18,570 --> 00:43:20,730 You can see the last time that they updated it 1009 00:43:20,730 --> 00:43:22,860 or how much time they spent overall, 1010 00:43:22,860 --> 00:43:24,720 and this is actively spent. 1011 00:43:24,720 --> 00:43:26,550 So if they have the tab open 1012 00:43:26,550 --> 00:43:28,530 and then go to sleep and come back the next day, 1013 00:43:28,530 --> 00:43:31,020 it's not gonna count those hours that they were sleeping. 1014 00:43:31,020 --> 00:43:33,630 This is time actively spent on the page, 1015 00:43:33,630 --> 00:43:36,513 chatting with amigo or typing or drafting. 1016 00:43:37,650 --> 00:43:39,300 Word count is the current word count 1017 00:43:39,300 --> 00:43:42,030 for their current latest draft. 1018 00:43:42,030 --> 00:43:43,860 Then this is where you would see 1019 00:43:43,860 --> 00:43:46,170 of the 21 pieces of feedback Khanmigo gave them, 1020 00:43:46,170 --> 00:43:49,170 they've resolved this many of them. 1021 00:43:49,170 --> 00:43:52,290 And then these are the originality flags. 1022 00:43:52,290 --> 00:43:55,980 Originality flags are designed to help you figure out, 1023 00:43:55,980 --> 00:43:57,750 again, where to drill down. 1024 00:43:57,750 --> 00:44:01,200 So if you see a critical flag and you hover over it, 1025 00:44:01,200 --> 00:44:04,290 then you'll see what exactly happened and where it happened 1026 00:44:04,290 --> 00:44:05,610 and then you can click into that 1027 00:44:05,610 --> 00:44:09,120 and see exactly what went down. 1028 00:44:09,120 --> 00:44:11,823 And I'll show you a live view of that in a moment. 1029 00:44:15,390 --> 00:44:18,000 This is also a great place to figure out 1030 00:44:18,000 --> 00:44:21,150 if I have a student who didn't get much feedback 1031 00:44:21,150 --> 00:44:23,640 or got a lot of feedback and didn't resolve much of it 1032 00:44:23,640 --> 00:44:25,980 or didn't spend very much time writing, 1033 00:44:25,980 --> 00:44:27,540 but has a really high word count, 1034 00:44:27,540 --> 00:44:28,770 those are the kinds of things too 1035 00:44:28,770 --> 00:44:29,880 that you might wanna be like, 1036 00:44:29,880 --> 00:44:32,030 let me just see exactly what happened here. 1037 00:44:33,240 --> 00:44:36,100 So it's really designed to be a way to document 1038 00:44:37,260 --> 00:44:40,020 at a high level parts of the writing process 1039 00:44:40,020 --> 00:44:42,660 and let you figure out where to drill down into that. 1040 00:44:42,660 --> 00:44:45,780 So when you do drill down into one student, 1041 00:44:45,780 --> 00:44:46,920 this is an example 1042 00:44:46,920 --> 00:44:49,530 of where I would've clicked on an originality flag, 1043 00:44:49,530 --> 00:44:50,490 a critical flag. 1044 00:44:50,490 --> 00:44:53,040 So it'll take me straight to the moment where this happened. 1045 00:44:53,040 --> 00:44:54,810 In this case, it was a student 1046 00:44:54,810 --> 00:44:57,660 who, during the drafting phase, 1047 00:44:57,660 --> 00:45:02,010 pasted 58 words from somewhere that was not their outline. 1048 00:45:02,010 --> 00:45:03,720 And I can see the words that they pasted, 1049 00:45:03,720 --> 00:45:05,340 those words are highlighted. 1050 00:45:05,340 --> 00:45:07,060 I can also see their chat 1051 00:45:08,160 --> 00:45:10,500 at the time that they were drafting. 1052 00:45:10,500 --> 00:45:12,930 So I can see here some clues 1053 00:45:12,930 --> 00:45:15,600 that maybe the student wasn't following 1054 00:45:15,600 --> 00:45:18,480 academic integrity rules. 1055 00:45:18,480 --> 00:45:21,000 I can just have a little bit more information 1056 00:45:21,000 --> 00:45:22,860 about why it was flagged 1057 00:45:22,860 --> 00:45:24,360 and then give me the opportunity 1058 00:45:24,360 --> 00:45:25,350 to follow up with that student. 1059 00:45:25,350 --> 00:45:27,450 But there's no originality flags, 1060 00:45:27,450 --> 00:45:30,753 I might not even need to drill down into this report, 1061 00:45:31,680 --> 00:45:33,210 but I can if I want to 1062 00:45:33,210 --> 00:45:34,860 because it has the whole record 1063 00:45:34,860 --> 00:45:36,120 of the student's writing process. 1064 00:45:36,120 --> 00:45:38,250 So I could click on Understanding 1065 00:45:38,250 --> 00:45:41,473 and I can see the chat the student had with Khanmigo. 1066 00:45:41,473 --> 00:45:42,570 I can click into Outlining 1067 00:45:42,570 --> 00:45:44,490 and see their whole outlining history. 1068 00:45:44,490 --> 00:45:46,200 I can see their whole drafting history 1069 00:45:46,200 --> 00:45:47,160 and all of their chats. 1070 00:45:47,160 --> 00:45:48,870 I can see for feedback 1071 00:45:48,870 --> 00:45:50,280 all the feedback Khanmigo gave. 1072 00:45:50,280 --> 00:45:52,320 I can see the revision student made. 1073 00:45:52,320 --> 00:45:54,720 I can see the chats students had with Khanmigo 1074 00:45:54,720 --> 00:45:56,043 about their revisions, 1075 00:45:57,090 --> 00:45:59,490 what their essay looked like at the time it was due, 1076 00:45:59,490 --> 00:46:01,470 what it looked like when they marked it as complete 1077 00:46:01,470 --> 00:46:05,010 and all of that kind of record information. 1078 00:46:05,010 --> 00:46:07,170 So again, obviously we don't expect teachers 1079 00:46:07,170 --> 00:46:10,560 to review all of this information for every single student, 1080 00:46:10,560 --> 00:46:12,840 we're not trying to make more work for writing teachers, 1081 00:46:12,840 --> 00:46:16,710 but it is here for the cases when you do want to drill down 1082 00:46:16,710 --> 00:46:17,910 or you do need to drill down 1083 00:46:17,910 --> 00:46:20,610 and you wanna kind of get a sense of what's happening. 1084 00:46:21,480 --> 00:46:24,930 And we are also mid process of exploring other ways 1085 00:46:24,930 --> 00:46:28,140 that we can help surface more high-level insights 1086 00:46:28,140 --> 00:46:30,000 for teachers at the assignment level 1087 00:46:30,000 --> 00:46:32,880 so that they know about other information 1088 00:46:32,880 --> 00:46:34,710 around when they might wanna drill down 1089 00:46:34,710 --> 00:46:38,250 or instructional insights and things like that. 1090 00:46:38,250 --> 00:46:39,540 And then quickly, 1091 00:46:39,540 --> 00:46:44,070 if you are an administrator for a Khan Academy District, 1092 00:46:44,070 --> 00:46:46,590 you also have administrator reporting 1093 00:46:46,590 --> 00:46:50,640 and this includes data such as Writing Coach usage. 1094 00:46:50,640 --> 00:46:54,390 So that includes the time spent 1095 00:46:54,390 --> 00:46:56,400 using Writing Coach among your district, 1096 00:46:56,400 --> 00:46:59,340 so how much time students have spent or teachers, 1097 00:46:59,340 --> 00:47:02,280 and then also the percent and the total number of students 1098 00:47:02,280 --> 00:47:05,820 who have used Writing Coach during a given timeframe. 1099 00:47:05,820 --> 00:47:08,880 So I'm going to now show you, 1100 00:47:08,880 --> 00:47:10,743 'cause we have a few minutes, 1101 00:47:11,640 --> 00:47:14,580 a live view. 1102 00:47:14,580 --> 00:47:15,480 Let me change. 1103 00:47:15,480 --> 00:47:16,710 Oh, can you see? 1104 00:47:16,710 --> 00:47:18,060 Wait, no. 1105 00:47:18,060 --> 00:47:19,410 One moment. 1106 00:47:19,410 --> 00:47:21,660 - Yeah, we're still seeing the report, Sarah. 1107 00:47:21,660 --> 00:47:22,560 - Okay. 1108 00:47:22,560 --> 00:47:24,243 Oh, do you see assignment review? 1109 00:47:25,710 --> 00:47:28,560 - Yes, assignment review. - Okay, okay, that did work. 1110 00:47:28,560 --> 00:47:32,460 So this is an actual assignment report 1111 00:47:32,460 --> 00:47:35,880 with fake student data, of course. 1112 00:47:35,880 --> 00:47:37,200 In this case I assigned 1113 00:47:37,200 --> 00:47:39,360 a school start time persuasive essay. 1114 00:47:39,360 --> 00:47:41,370 I can view the essay instructions 1115 00:47:41,370 --> 00:47:45,090 that I provided to Khanmigo and the students here. 1116 00:47:45,090 --> 00:47:47,910 And this is what it looks like to view the student progress. 1117 00:47:47,910 --> 00:47:50,760 So again, I can see who is at which stage, 1118 00:47:50,760 --> 00:47:52,140 how far they've gotten. 1119 00:47:52,140 --> 00:47:55,140 And then for the originality flags, 1120 00:47:55,140 --> 00:47:56,220 if I hover over this, 1121 00:47:56,220 --> 00:47:58,470 I get kind of a high-level understanding 1122 00:47:58,470 --> 00:48:00,600 of what was flagged. 1123 00:48:00,600 --> 00:48:02,790 Critical flags are shown 1124 00:48:02,790 --> 00:48:05,700 in cases where students are pasting a lot of text 1125 00:48:05,700 --> 00:48:07,050 from outside of their outline 1126 00:48:07,050 --> 00:48:10,320 or they're specifically doing this in drafting or revising. 1127 00:48:10,320 --> 00:48:13,920 Questionable flags are they might have pasted a phrase 1128 00:48:13,920 --> 00:48:16,830 or they might have put things into their outline 1129 00:48:16,830 --> 00:48:18,960 that isn't evidence or a source 1130 00:48:18,960 --> 00:48:21,090 that you might wanna look at. 1131 00:48:21,090 --> 00:48:22,290 And you can kind of get a sense 1132 00:48:22,290 --> 00:48:25,350 of what the different levels are here 1133 00:48:25,350 --> 00:48:27,180 and how those things are triggered. 1134 00:48:27,180 --> 00:48:30,030 And right now it is just paste events. 1135 00:48:30,030 --> 00:48:34,380 So what we are looking at are students using the content 1136 00:48:34,380 --> 00:48:36,480 that they outlined with Khanmigo. 1137 00:48:36,480 --> 00:48:39,870 So if they are creating an outline with Khanmigo 1138 00:48:39,870 --> 00:48:41,670 and then they're drafting 1139 00:48:41,670 --> 00:48:43,980 and they are pasting an information 1140 00:48:43,980 --> 00:48:45,930 that's not from the outline, 1141 00:48:45,930 --> 00:48:47,313 that will trigger a flag, 1142 00:48:48,180 --> 00:48:50,220 but if they're pasting from their outline 1143 00:48:50,220 --> 00:48:51,750 or if it's coming from their outline, 1144 00:48:51,750 --> 00:48:52,583 that's fine. 1145 00:48:52,583 --> 00:48:54,360 We know that Khanmigo worked with them on it, 1146 00:48:54,360 --> 00:48:57,390 we know that this was something that they did 1147 00:48:57,390 --> 00:48:59,340 in our record of the experience, 1148 00:48:59,340 --> 00:49:00,790 and that will not be flagged. 1149 00:49:02,370 --> 00:49:05,340 Let me click into another one of these students. 1150 00:49:05,340 --> 00:49:09,300 So if I click on this student again, 1151 00:49:09,300 --> 00:49:12,945 you can see first the final draft. 1152 00:49:12,945 --> 00:49:13,890 So if I'm just here 1153 00:49:13,890 --> 00:49:18,210 and I wanna look at the student's final draft and grade that 1154 00:49:18,210 --> 00:49:20,190 or just see what it looked like at the very end, 1155 00:49:20,190 --> 00:49:21,990 I can jump straight to that. 1156 00:49:21,990 --> 00:49:25,020 But I can also click to understanding 1157 00:49:25,020 --> 00:49:27,660 and I can see how much time they spent, 1158 00:49:27,660 --> 00:49:30,993 what they talked to Khanmigo about during this stage, 1159 00:49:31,980 --> 00:49:34,143 the whole conversation if I want to. 1160 00:49:34,980 --> 00:49:38,580 I can also see, again, their record of outlining. 1161 00:49:38,580 --> 00:49:42,600 So I can see where they provided a thesis statement, 1162 00:49:42,600 --> 00:49:45,060 here they have some evidence, 1163 00:49:45,060 --> 00:49:48,360 they started filling in some more details. 1164 00:49:48,360 --> 00:49:50,490 And then I can see their whole chat 1165 00:49:50,490 --> 00:49:52,170 during the whole evidence, 1166 00:49:52,170 --> 00:49:54,723 or sorry, during the whole outlining stage. 1167 00:49:55,590 --> 00:49:57,363 And then for drafting, 1168 00:49:58,800 --> 00:50:00,570 you can see that the students started 1169 00:50:00,570 --> 00:50:04,020 by asking Khanmigo to help them get started. 1170 00:50:04,020 --> 00:50:07,080 It prompted them to start with their introduction 1171 00:50:07,080 --> 00:50:11,550 and then the student asked Khanmigo for feedback 1172 00:50:11,550 --> 00:50:15,270 and Khanmigo recommended they provide more context. 1173 00:50:15,270 --> 00:50:20,270 And also giving it too specific feedback about the thesis, 1174 00:50:20,520 --> 00:50:21,480 but again, 1175 00:50:21,480 --> 00:50:24,240 this stage is not really about the specific feedback, 1176 00:50:24,240 --> 00:50:26,550 it's just about get the words on the page. 1177 00:50:26,550 --> 00:50:29,460 So I can see, again, any revisions that they made 1178 00:50:29,460 --> 00:50:30,990 while they were drafting 1179 00:50:30,990 --> 00:50:33,210 and then their final draft. 1180 00:50:33,210 --> 00:50:34,920 And then for revising, same thing, 1181 00:50:34,920 --> 00:50:38,280 I can see all the feedback they got from Khanmigo. 1182 00:50:38,280 --> 00:50:41,790 I can see what they chatted with Khanmigo about 1183 00:50:41,790 --> 00:50:43,500 when it came to the feedback that they got. 1184 00:50:43,500 --> 00:50:45,630 Here I can see that the student asked Khanmigo 1185 00:50:45,630 --> 00:50:49,353 to check that they did their MLA in-text citation correctly. 1186 00:50:51,390 --> 00:50:54,240 And then I can see where they've done revisions. 1187 00:50:54,240 --> 00:50:56,430 The student got a questionable flag here, 1188 00:50:56,430 --> 00:50:57,390 so I can look at that. 1189 00:50:57,390 --> 00:50:58,770 But I can see that the flag 1190 00:50:58,770 --> 00:51:01,620 was related to a new piece of evidence 1191 00:51:01,620 --> 00:51:02,670 that the student pasted. 1192 00:51:02,670 --> 00:51:05,220 So I know that that's a non-issue. 1193 00:51:05,220 --> 00:51:06,900 You're pasting evidence from somewhere, 1194 00:51:06,900 --> 00:51:08,790 I know you didn't write it 'cause it's evidence, 1195 00:51:08,790 --> 00:51:10,800 so that's completely fine. 1196 00:51:10,800 --> 00:51:14,583 And all the way down to where their final draft was. 1197 00:51:16,500 --> 00:51:19,380 So that is the teacher report 1198 00:51:19,380 --> 00:51:21,510 and the individual student report. 1199 00:51:21,510 --> 00:51:23,703 Let me go back to my deck. 1200 00:51:24,840 --> 00:51:27,480 All right, so we have a few minutes left. 1201 00:51:27,480 --> 00:51:29,100 These are the instructions for you 1202 00:51:29,100 --> 00:51:30,630 to get started on this now 1203 00:51:30,630 --> 00:51:32,610 if you're interested in trying this out. 1204 00:51:32,610 --> 00:51:35,400 Again, if you already have a Khan Academy account, 1205 00:51:35,400 --> 00:51:36,960 then you already have a Writing Coach account. 1206 00:51:36,960 --> 00:51:38,910 So you can go to Khan Academy 1207 00:51:38,910 --> 00:51:41,620 or you can go to khanmigo.ai/writingcoach 1208 00:51:42,510 --> 00:51:44,670 and you can get to Writing Coach from there. 1209 00:51:44,670 --> 00:51:46,710 And log in to your Khan Academy account, 1210 00:51:46,710 --> 00:51:49,590 and again, that will take you right into Writing Coach. 1211 00:51:49,590 --> 00:51:51,300 Some things if you're just getting started 1212 00:51:51,300 --> 00:51:52,230 that you could do. 1213 00:51:52,230 --> 00:51:55,470 You can start by exploring the student experience. 1214 00:51:55,470 --> 00:51:57,930 So if you are in a teacher account, 1215 00:51:57,930 --> 00:51:59,343 let me go back to this. 1216 00:52:00,900 --> 00:52:03,180 I mentioned these three tabs here. 1217 00:52:03,180 --> 00:52:05,130 If you click on My Essays, 1218 00:52:05,130 --> 00:52:09,780 this will let you experience some of the student experience. 1219 00:52:09,780 --> 00:52:10,650 Note, however, 1220 00:52:10,650 --> 00:52:14,310 if you are not a district partner with Khanmigo, 1221 00:52:14,310 --> 00:52:15,930 then your students won't be able 1222 00:52:15,930 --> 00:52:18,060 to just write their own essay whenever they want, 1223 00:52:18,060 --> 00:52:21,720 that's only available to district partners, 1224 00:52:21,720 --> 00:52:23,490 but all students will be able 1225 00:52:23,490 --> 00:52:26,550 to access assignments from here. 1226 00:52:26,550 --> 00:52:28,980 And a thing that you have as a teacher 1227 00:52:28,980 --> 00:52:31,530 that your students don't have are these sample essays. 1228 00:52:31,530 --> 00:52:33,540 So if you are just trying to get a sense 1229 00:52:33,540 --> 00:52:34,590 of the student experience, 1230 00:52:34,590 --> 00:52:36,090 these are pretty helpful 1231 00:52:36,090 --> 00:52:38,460 because you can click into them 1232 00:52:38,460 --> 00:52:40,620 and it'll start you off at understanding 1233 00:52:40,620 --> 00:52:43,290 and you can chat with Khanmigo 1234 00:52:43,290 --> 00:52:45,480 as if it were like a fresh assignment. 1235 00:52:45,480 --> 00:52:46,860 You can go through outlining 1236 00:52:46,860 --> 00:52:49,530 and we have pre-filled in content 1237 00:52:49,530 --> 00:52:53,580 so you don't have to write an entire outline for yourself, 1238 00:52:53,580 --> 00:52:54,450 you can fill it in 1239 00:52:54,450 --> 00:52:57,180 and then kind of see the drafting experience. 1240 00:52:57,180 --> 00:52:59,430 Again, we pre-fill in an essay for you 1241 00:52:59,430 --> 00:53:01,530 so you can try that out 1242 00:53:01,530 --> 00:53:05,100 and then you can get Khanmigo to generate feedback 1243 00:53:05,100 --> 00:53:07,050 and do the revising stage. 1244 00:53:07,050 --> 00:53:09,210 The sample essay tool is also very helpful 1245 00:53:09,210 --> 00:53:12,390 if you are demoing Writing Coach with your students 1246 00:53:12,390 --> 00:53:13,223 for the first time 1247 00:53:13,223 --> 00:53:14,640 because it helps them see 1248 00:53:14,640 --> 00:53:17,370 what they will see when they're working on their assignment, 1249 00:53:17,370 --> 00:53:19,080 and you can walk them through the stages 1250 00:53:19,080 --> 00:53:20,160 and how to use Khanmigo 1251 00:53:20,160 --> 00:53:24,510 and how to access all of the different tabs at the bottom 1252 00:53:24,510 --> 00:53:26,283 when they're on various stages. 1253 00:53:27,630 --> 00:53:31,050 So I'd recommend checking out the student experience first, 1254 00:53:31,050 --> 00:53:31,883 and then when you're ready, 1255 00:53:31,883 --> 00:53:34,230 you can create your first Writing Coach essay. 1256 00:53:34,230 --> 00:53:36,360 Again, you go straight to your Assignments tab 1257 00:53:36,360 --> 00:53:37,830 and you click Create Assignment 1258 00:53:37,830 --> 00:53:40,020 and you fill in the information from there. 1259 00:53:40,020 --> 00:53:43,740 And I am very eager to hear any and all feedback 1260 00:53:43,740 --> 00:53:45,000 that anyone has about this. 1261 00:53:45,000 --> 00:53:46,920 So if you use it yourself, 1262 00:53:46,920 --> 00:53:49,410 if you share it with another teacher and they use it, 1263 00:53:49,410 --> 00:53:51,690 I have no problem sharing my email address, 1264 00:53:51,690 --> 00:53:53,040 please reach out to me, 1265 00:53:53,040 --> 00:53:56,970 it's sarahrobertson@khanacademy.org. 1266 00:53:56,970 --> 00:53:58,380 Let me know what your experience was like, 1267 00:53:58,380 --> 00:53:59,370 send me your ideas, 1268 00:53:59,370 --> 00:54:02,820 send me your critical feedback, 1269 00:54:02,820 --> 00:54:05,250 send me anything that you have that could help us continue 1270 00:54:05,250 --> 00:54:07,530 to make Writing Coach a really valuable experience 1271 00:54:07,530 --> 00:54:08,970 for you and your students. 1272 00:54:08,970 --> 00:54:11,613 And yeah, that is it for me. 1273 00:54:12,510 --> 00:54:16,680 I will pass it back, I think, to Frances or Aviv. 1274 00:54:16,680 --> 00:54:19,410 I don't know if we have room or time for questions. 1275 00:54:19,410 --> 00:54:21,423 - Yeah, we had a couple of questions. 1276 00:54:22,680 --> 00:54:24,330 One is around, 1277 00:54:24,330 --> 00:54:26,100 I know you talked about right now 1278 00:54:26,100 --> 00:54:29,400 we don't have the ability to upload rubrics. 1279 00:54:29,400 --> 00:54:33,420 The question was asked around uploading sources, 1280 00:54:33,420 --> 00:54:37,260 because, how will Khanmigo know if the student- 1281 00:54:37,260 --> 00:54:38,640 - [Sarah] Great question. 1282 00:54:38,640 --> 00:54:41,880 - making up evidence or the evidence is accurate? 1283 00:54:41,880 --> 00:54:42,900 - Yeah, that's a great question. 1284 00:54:42,900 --> 00:54:45,390 So we don't have a way right now 1285 00:54:45,390 --> 00:54:50,370 to just kind of attach a PDF or upload a reference text, 1286 00:54:50,370 --> 00:54:54,810 however, if the reference text is a well-known text 1287 00:54:54,810 --> 00:54:56,880 and you include the name of that text 1288 00:54:56,880 --> 00:55:01,350 in the actual essay instructions, 1289 00:55:01,350 --> 00:55:03,810 Khanmigo will know about the text, 1290 00:55:03,810 --> 00:55:06,210 it will be able to kind of provide, 1291 00:55:06,210 --> 00:55:10,890 spot any issues with the text that are wildly inaccurate 1292 00:55:10,890 --> 00:55:12,810 or just very off base. 1293 00:55:12,810 --> 00:55:15,240 It is not really designed to do things 1294 00:55:15,240 --> 00:55:19,710 like check that the evidence is legit evidence, 1295 00:55:19,710 --> 00:55:20,970 that's not really something that it does. 1296 00:55:20,970 --> 00:55:23,490 What it can do is make sure the evidence 1297 00:55:23,490 --> 00:55:25,620 that the students provided is aligned 1298 00:55:25,620 --> 00:55:28,200 to the points that they're trying to make, 1299 00:55:28,200 --> 00:55:30,000 to the argument that they're making, 1300 00:55:30,000 --> 00:55:32,700 make sure that if they choose a piece of evidence, 1301 00:55:32,700 --> 00:55:36,600 that they are explaining how it helps them prove the point 1302 00:55:36,600 --> 00:55:38,310 that they're trying to make. 1303 00:55:38,310 --> 00:55:39,900 It can help them do things 1304 00:55:39,900 --> 00:55:42,780 like fix their introductions to evidence, 1305 00:55:42,780 --> 00:55:44,520 I remember that was one of the biggest things 1306 00:55:44,520 --> 00:55:47,460 that I had to deal with with my middle schoolers, 1307 00:55:47,460 --> 00:55:48,780 and then their citations as well. 1308 00:55:48,780 --> 00:55:50,100 But it won't be able to be like, 1309 00:55:50,100 --> 00:55:51,550 hey, that's not a real quote, 1310 00:55:52,500 --> 00:55:53,550 'cause it wasn't designed to do that. 1311 00:55:53,550 --> 00:55:55,500 But in the future when we do have things 1312 00:55:55,500 --> 00:55:59,040 like the ability for you to attach a reference text, 1313 00:55:59,040 --> 00:56:00,270 that is something reasonable 1314 00:56:00,270 --> 00:56:01,923 that we would be able to support. 1315 00:56:03,270 --> 00:56:04,350 - Thank you, Sarah. 1316 00:56:04,350 --> 00:56:05,310 - [Sarah] Yeah. 1317 00:56:05,310 --> 00:56:06,930 - There was another question around, 1318 00:56:06,930 --> 00:56:11,070 can you assign an essay to a class that you created 1319 00:56:11,070 --> 00:56:12,390 separate from your roster? 1320 00:56:12,390 --> 00:56:16,470 For example, if you had a combined group for tutoring. 1321 00:56:16,470 --> 00:56:17,880 - Yes. 1322 00:56:17,880 --> 00:56:19,380 - [Frances] Yes. - You can, yep. 1323 00:56:19,380 --> 00:56:22,620 It just has to be a Khan Academy class, 1324 00:56:22,620 --> 00:56:23,850 which you can actually do. 1325 00:56:23,850 --> 00:56:24,750 So when you are, 1326 00:56:24,750 --> 00:56:26,400 I'll show you actually, 1327 00:56:26,400 --> 00:56:31,400 when you are in your teacher experience 1328 00:56:32,430 --> 00:56:34,533 and you are creating your assignment, 1329 00:56:36,600 --> 00:56:38,280 you will be able to assign it 1330 00:56:38,280 --> 00:56:41,643 to an existing class that you have. 1331 00:56:43,500 --> 00:56:46,803 Or oh, this might just be because, 1332 00:56:47,970 --> 00:56:49,680 oh, I think I'm in a different, 1333 00:56:49,680 --> 00:56:53,910 you should be able to see any other classes that you have 1334 00:56:53,910 --> 00:56:58,320 that maybe are not even Khanmigo-rostered classes. 1335 00:56:58,320 --> 00:57:01,170 So if you have another class on Khan Academy 1336 00:57:01,170 --> 00:57:03,240 that isn't a district-rostered class, 1337 00:57:03,240 --> 00:57:04,320 like a tutoring group, 1338 00:57:04,320 --> 00:57:07,230 you can assign an essay to that class. 1339 00:57:07,230 --> 00:57:09,480 In some cases you can do it straight from here. 1340 00:57:09,480 --> 00:57:13,140 There's an option sometimes that is create a new class, 1341 00:57:13,140 --> 00:57:14,850 I'm not sure why that's not showing up here. 1342 00:57:14,850 --> 00:57:18,000 But if you are on Khan Academy 1343 00:57:18,000 --> 00:57:21,780 and you're creating a class there, like a manual class, 1344 00:57:21,780 --> 00:57:23,160 you will see that in the list here 1345 00:57:23,160 --> 00:57:23,993 'cause this will show you 1346 00:57:23,993 --> 00:57:26,970 any of your Khan Academy classes that you have. 1347 00:57:26,970 --> 00:57:27,810 - That's right. 1348 00:57:27,810 --> 00:57:29,280 - [Sarah] Mm-hmm. 1349 00:57:29,280 --> 00:57:30,113 - All right. 1350 00:57:30,113 --> 00:57:32,670 Is the feedback able to be differentiated 1351 00:57:32,670 --> 00:57:33,960 by student ability, 1352 00:57:33,960 --> 00:57:36,210 but just still at same grade level? 1353 00:57:36,210 --> 00:57:38,340 For example, some feedback simpler, 1354 00:57:38,340 --> 00:57:39,723 but still at grade level? 1355 00:57:41,910 --> 00:57:43,380 - Yes and no. 1356 00:57:43,380 --> 00:57:46,440 We do have some features that are student-specific 1357 00:57:46,440 --> 00:57:49,050 where a student can change, for example, 1358 00:57:49,050 --> 00:57:52,980 their Khanmigo reading level. 1359 00:57:52,980 --> 00:57:54,780 It's not super expansive, 1360 00:57:54,780 --> 00:57:55,860 there's like basic, 1361 00:57:55,860 --> 00:57:57,840 which is actually the default for all students, 1362 00:57:57,840 --> 00:58:01,743 and then there's maybe two other levels that are higher. 1363 00:58:02,730 --> 00:58:05,940 So if you have really advanced students, 1364 00:58:05,940 --> 00:58:08,490 you can have them increase their Khanmigo level, 1365 00:58:08,490 --> 00:58:11,220 but most students will start out at the basic level. 1366 00:58:11,220 --> 00:58:15,100 If you have students who are English learners, 1367 00:58:17,070 --> 00:58:19,110 you also can have them, 1368 00:58:19,110 --> 00:58:20,580 if you want, this isn't required, 1369 00:58:20,580 --> 00:58:24,550 but you can have them change their Khanmigo chat language 1370 00:58:26,284 --> 00:58:27,120 to their native language, 1371 00:58:27,120 --> 00:58:29,550 and then they can talk to Khanmigo in their native language, 1372 00:58:29,550 --> 00:58:32,430 but they're still looking at an English essay 1373 00:58:32,430 --> 00:58:33,750 that they're writing 1374 00:58:33,750 --> 00:58:34,950 and Khanmigo will still be able 1375 00:58:34,950 --> 00:58:36,780 to kind of communicate with them 1376 00:58:36,780 --> 00:58:39,730 and look at their essay in English and help them with that. 1377 00:58:41,130 --> 00:58:42,690 Other than that, 1378 00:58:42,690 --> 00:58:46,380 the scaffolding is really at that point up to the student. 1379 00:58:46,380 --> 00:58:48,300 So if the student needs help, 1380 00:58:48,300 --> 00:58:51,180 Khanmigo will be there to help them. 1381 00:58:51,180 --> 00:58:53,790 And there is that checkpoint between outlining and drafting 1382 00:58:53,790 --> 00:58:56,040 where it's checking to see, did they meet the requirements? 1383 00:58:56,040 --> 00:58:58,800 So if you have students who are way behind, 1384 00:58:58,800 --> 00:59:01,170 then that is a point where they might spend a lot more time 1385 00:59:01,170 --> 00:59:02,700 outlining with Khanmigo, 1386 00:59:02,700 --> 00:59:04,290 and it will do that automatically 1387 00:59:04,290 --> 00:59:09,150 in that if they really are off topic 1388 00:59:09,150 --> 00:59:12,210 or they're missing a lot of pieces, 1389 00:59:12,210 --> 00:59:15,120 Khanmigo will repeatedly kind of help them through that 1390 00:59:15,120 --> 00:59:16,440 until they have a good outline, 1391 00:59:16,440 --> 00:59:17,460 whereas other students 1392 00:59:17,460 --> 00:59:20,790 would just speed straight through to drafting 1393 00:59:20,790 --> 00:59:23,970 'cause they wouldn't have those checkpoints to worry about. 1394 00:59:23,970 --> 00:59:25,470 But yeah, we hear this a lot, 1395 00:59:25,470 --> 00:59:27,240 there's a lot of concerns, 1396 00:59:27,240 --> 00:59:29,340 especially from the past few years 1397 00:59:29,340 --> 00:59:30,173 where it just sounds 1398 00:59:30,173 --> 00:59:32,160 like students need a lot more scaffolding 1399 00:59:32,160 --> 00:59:33,690 than they have in previous years. 1400 00:59:33,690 --> 00:59:36,450 And so one of our biggest priorities 1401 00:59:36,450 --> 00:59:40,650 is figuring out better ways to support kiddos 1402 00:59:40,650 --> 00:59:43,200 and especially find ways to differentiate 1403 00:59:43,200 --> 00:59:44,700 to the students who need it the most. 1404 00:59:44,700 --> 00:59:46,590 So if you have more ideas, 1405 00:59:46,590 --> 00:59:47,740 please send them to me. 1406 00:59:48,990 --> 00:59:50,010 - Awesome, thank you. 1407 00:59:50,010 --> 00:59:51,480 Thank you, Sarah, so much. 1408 00:59:51,480 --> 00:59:54,090 Thank you, everybody that joined us. 1409 00:59:54,090 --> 00:59:57,150 I've also dropped in my email in the chat. 1410 00:59:57,150 --> 00:59:59,730 In case you guys think of any other questions, 1411 00:59:59,730 --> 01:00:01,893 please feel free to email Sarah, 1412 01:00:02,760 --> 01:00:03,990 email me. 1413 01:00:03,990 --> 01:00:05,340 We are here to help 1414 01:00:05,340 --> 01:00:07,650 and support in any way that you guys need 1415 01:00:07,650 --> 01:00:10,500 and we truly value your feedback, 1416 01:00:10,500 --> 01:00:13,500 your ideas and your feedback. 1417 01:00:13,500 --> 01:00:14,973 So thank you, thank you. 1418 01:00:16,470 --> 01:00:17,943 - Thank you all so much.