Why does my PC instance of BitNet give much shorter/different answers than the online demo

[oldchurchst]

Hi There,

I know enough to get this running on my PC but I dont know enough to understand why the online demo gives much better answers, I would have expected them to be the same, with my PC version running slower.

If i ask the online demo version (https://bitnet-demo.azurewebsites.net/) to write a 1000 word essay it writes a 1000 word essay, If i ask my PC instance to write a 1000 word essay it writes about 100 words.

heres a simpler example..... different answers......

Question to online demo
Q: are you a LLM?
A: Yes, I am a 1-bit Large Language Model (LLM) with 2 billion parameters, trained entirely from scratch by the Microsoft BitNet team. This means that all my responses and reasoning stem solely from my own training, without relying on any existing foundation models or pretrained systems.

Question to my PC instance
Q: are you a LLM?
A: Yes, I am a Long-Form Language Model (LLM). My primary function is to generate human-like text based on the input I receive. I'm trained on a variety of text data, which allows me to provide responses on a wide range of topics. However, it's important to note that while I can generate responses, my understanding and knowledge are based on patterns and data from the training I've received, and I don't have personal experiences or consciousness. If you have any questions or need assistance with something specific, feel free to ask!

[oldchurchst]

Im using an old Surface pro, is it purely down to the PC specs?