pull down to refresh
30 sats \ 4 replies \ @Hakuna 17 Apr \ on: What do you think is a fair way of dealing with cheaters? AskSN
I think you're encountering a huge systemic earthcrack in the education system, which starts to build up and challenge every single cognitive test hoop we've established over the past centuries. And you're not going to be able to plaster that crack on your own with what used to work before.
I'm talking about this with some of my friends for a while, and this story is a phenomenal canary:
TLDR; a talented engineering student from Columbia University exposes the Mag7 Tech Interviewing process with an almost perfected AI interviewing ammunition belt. He secures all the job offerings, but instead of taking those, exposing that way of interviewing in the new world doesn't work anymore.
How do you mitigate this? Flying every interviewee in for face2face offline interviews? How is that proving they are up to the world of engineering in 5 years, 3 years even? How do you mitigate smart glasses, who'll boost every applicant to have a helper PhD in their pocket / ear / on their nose?
Possibly the better, but more challenging way: Question the way you weed out great talent, support the ones who struggle adopting the new ways, because in reality, this wave cannot be stopped anymore.
I know you're not going to revolutionise the education system on your own. But my current hypothesis is, what got us here isn't going to get us there. We all have to think more expansive how we're going to show empathy, support and provide value in this totally new predicament of AI.
Final thoughts: Is it fair to put them into oral assessment? Probably, yes. As a one off. Perhaps with a ceiling and a floor for the grades.
How about doing a repetition, and everyone (who can, ) can use an AI Pocket helper. And perhaps this will create some interesting results. At least it'll stir up an interesting discussion in the classroom, how they all think about this?
Yeah, we're all struggling to deal with this. I agree, traditional assessment methods don't work well anymore.
But isn't oral examination the way we should be moving? The real test of knowledge is how a person interacts with you. The only problem is a lack of scalability.
reply
Yeah, oral would help, but imo not enough. We need to also stresstest What we're actually trying them to proof: Cognitive abilities, adapting to change, thinking on their heels, creative thinking, abstracting is the way to go.
Memorizing, summarizing, visualising stuff? Phew, I dunno.
Keeps reminding me of two things:
- The cab driver test in London was the hardest test. They throw two street names at you, you had to explain, street by street, turn by turn, how to get from A to B. Guess how many use that knowledge today?
- One internet meme I remember: I'd love to have a version of the olympics, where every athlete could go full bonkers on steroids and drugs. Let's see how high humans can really jump
reply
Honestly, my ideal would be just have one assignment:
"You have one semester to impress me with an awesome project. Go at it!"
But the problem is actually grading it.
On the other hand, maybe I don't really need to grade it. Just need to grade it enough so that they actually do the work. But the real point is just to get them to do it. Then, any future employer can look more carefully at the quality of work, and interview them, and see if it's someone they want to work with.
reply
reply