Hey Jie, I agree to a certain extent and I think there are still many use-cases in content generation that small models can cater to if you get reasonable latency.

Which open-source LLM you would wish to have logit bias edit?