• 0 Posts
  • 27 Comments
Joined 1 year ago
cake
Cake day: June 14th, 2023

help-circle


  • rho50@lemmy.nztoTechnology@beehaw.orgBut Claude said tumor!
    link
    fedilink
    arrow-up
    13
    ·
    edit-2
    6 months ago

    I don’t think it’s necessarily a bad thing that an AI got it wrong.

    I think the bigger issue is why the AI model got it wrong. It got the diagnosis wrong because it is a language model and is fundamentally not fit for use as a diagnostic tool. Not even a screening/aid tool for physicians.

    There are AI tools designed for medical diagnoses, and those are indeed a major value-add for patients and physicians.



  • Exactly. So the organisations creating and serving these models need to be clearer about the fact that they’re not general purpose intelligence, and are in fact contextual language generators.

    I’ve seen demos of the models used as actual diagnostic aids, and they’re not LLMs (plus require a doctor to verify the result).


  • There are some very impressive AI/ML technologies that are already in use as part of existing medical software systems (think: a model that highlights suspicious areas on an MRI, or even suggests differential diagnoses). Further, other models have been built and demonstrated to perform extremely well on sample datasets.

    Funnily enough, those systems aren’t using language models 🙄

    (There is Google’s Med-PaLM, but I suspect it wasn’t very useful in practice, which is why we haven’t heard anything since the original announcement.)



  • I know of at least one other case in my social network where GPT-4 identified a gas bubble in someone’s large bowel as “likely to be an aggressive malignancy.” Leading to said person fully expecting they’d be dead by July, when in fact they were perfectly healthy.

    These things are not ready for primetime, and certainly not capable of doing the stuff that most people think they are.

    The misinformation is causing real harm.


  • I saw a job posting for Senior Software Engineer position at a large tech company (not Big Tech, but high profile and widely known) which required candidates to have “an excellent academic track record, including in high school.” A lot of these requirements feel deliberately arbitrary, and like an effort to thin the herd rather than filter for good candidates.





  • It’s an interesting idea! I think there are many such applications for federation protocols.

    A few thoughts/questions:

    • Ideally you’ll need a stable identifier for each specific product. Most small online stores I use have product names riddled with typos, so a way to tackle that would be nice.
    • What’s the data model? Would each store be an ActivityPub Actor? Like each one would have a username and publish inventory updates?
    • Where do these updates go (maybe something akin to a Lemmy “community”)?
    • If you’re just relying on stores’ self-reported stock levels, where’s the benefit of using a federated model? Could you just build an open source app that scrapes retailers’ websites and collates that information?
    • Is the eventual goal that this competes with Amazon et al? I.e. it becomes an actual marketplace, perhaps with a “buy” and “sell” Action, and where vendors’ instances are effectively web stores?







  • Discovered that the credentials for the library computers (which were helpfully printed on stickers for the forgetful librarians), were in fact domain admin credentials.

    Gave myself a domain admin account, used that to obtain access to some sensitive teacher-only systems (mostly for the challenge, but also because I wanted to know what was going on my school report ahead of time).

    My domain admin account got nuked, but presumably they didn’t know who had created it. Looked up the school’s vendor (“Research Machines Ltd.”) and found a list of default account credentials. Through trial and error, found another domain admin account. Made a new account (with a backup this time) and used it to install games on my classroom’s computers.

    Also changed the permissions on my home directory so that the school’s teachers (who were not domain admins) couldn’t view my files, because I felt that this was too invasive at the time.

    That last bit got me caught proper, and after a long afternoon in the principal’s office I left school systems alone after that for fear of having a black mark on my “permanent record”.