• 0 Posts
  • 13 Comments
Joined 2 years ago
cake
Cake day: July 13th, 2023

help-circle
  • I’m highly concerned about this, not only due to lack of control of software I can choose to install, but also what happens once a developer is blacklisted? I haven’t seen anyone really address this.

    What guidelines will Google use to determine that an app is “safe”? Will Google begin blacklisting developers who modify apps? What about developers who make apps that aren’t controversial themselves, but linked to controversial technologies or can be used for controversial means? (Torrent clients, etc.) Google to my knowledge has not provided a list of criteria they will use.

    Even if Google claims pure motivations now, I think the amount of control this policy carries will be far too tempting for Google to refuse to utilize in full for any cause.













  • xcjs@programming.devtoTechnology@lemmy.world*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    4 months ago

    That’s not how distillation works if I understand what you’re trying to explain.

    If you distill model A to a smaller model, you just get a smaller version of model A with the same approximate distribution curve of parameters, but fewer of them. You can’t distill Llama into Deepseek R1.

    I’ve been able to run distillations of Deepseek R1 up to 70B, and they’re all censored still. There is a version of Deepseek R1 “patched” with western values called R1-1776 that will answer topics censored by the Chinese government, however.