Microsoft Bing’s CEO Mikhail Parakhin tweeted that Bing Chat (Bing Chat) performance is better than simply GPT-4, but this requires a higher cost.
Replying to a user who thought Bing Chat was better than OpenAI’s GPT-4, Palahin said, “Based on our measurements, it does perform better.” It’s worth noting that Bing Chat is based on GPT-4 provided by OpenAI, but Parahin says that Bing uses retrieval-augmented inference.
The user wanted to know if Bing Chat offers an API to the public, to which Palahin said, “Yes, we have such a service, but it’s very expensive because its requires multiple model calls and search calls, so it’s only used by a few companies so far.”
Bing Chat uses the GPT-4 model developed by OpenAI, a deep learning-based natural language generation system that generates smooth and coherent text based on user input. However, GPT-4 alone does not fulfil users’ need for accurate and relevant information, so Bing Chat also incorporates retrieval-enhanced reasoning, which retrieves relevant information from the web before generating the text and incorporates it into the generation process, which improves the quality and credibility of the generated text.
However, retrieval-enhanced reasoning techniques have their drawbacks. First, it requires more computational resources and time to perform the retrieval and generation tasks, which can increase the cost and latency. Second, without proper filtering and validation mechanisms, inaccurate or irrelevant information may be introduced. Third, if there is no proper authorization and protection mechanism, some copyright or privacy issues may be violated.
Recently a number of users have reflected that the quality of Bing Chat’s answers has declined, to which Microsoft said the company is actively monitoring user feedback and plans to make changes to address these issues in the near future.
