Yeah, Reddit at times does seem like some bizarre group think type of thing in terms of how comments are downvoted or upvoted. Coming from Reddit, in Hackernews it seems people are more accepting of controversial ideas.
This is the one of the first items I load in when I start a new project as it makes it so much easier to visualize the data structure when each nested level is a different colour. Thought I would polish it up a bit and share it for those who may find it useful.
The game here is to get as many of your users as possible and keep them chatting with the LLM (copilot) to get the human / machine back and forth. When everything has been scraped already then the only advantage you can have is more chat logs. I suspect that we will see every large tech company start to push their own models (or skins) just as hard for that same reason. OpenAI is sitting on some of the most valuable data from their user base, and the long targeted conversations they have.
The amount of effort gone for these designs is unheard of in the generative day and age. At first I thought it was Ai generated design but the text is too clean, and the imagery way too relevant. Super impressed.
I’m with you on that. I’ve had a north face bag for almost 20 years (and it looks like it!) but it’s still strong as can be.
The unfortunate thing is I was in the market for a new bag and went to the north face store of course and the only bag they had in the whole store was some shoestring style bag. Quite disappointing to see north face forget their roots.
TLDR: Developers can now specify seed parameter in the Chat Completion request for consistent completions. We always include a system_fingerprint in the response that helps developers understand changes in our system that will affect determinism.
Thank you, I should have been more specific. I guess what I’m asking is, how deterministic would you say it is in your experience? Can this be used for classifying purposes where the values should not be outside what’s given in a variable input prompt , or when we say deterministic are we saying that , if given the same prompt then the output would be the exact same only? Or is the seed a starting parameter that effectively corners the LLM to a specific starting point only then depending on the variable prompts, potentially give non-deterministic answers?
Perhaps I’m misunderstanding how the seed is used in this context. If you have any examples of how you use it in real world context then that would be appreciated.
I’ve not had any success to make responses deterministic with these settings. I’m even beginning to suspect historic conversations via API are used to influence future responses, so I’m not sure if it’ll truly be possible.
The most success I’ve had for classifying purposes so far is using function calling and a hack-solution of making a new object for each data point you want to classify for the schema open AI wants. Then an inner prop that is static to place the value. Then within the description of that object is just a generic “choose from these values only: {CATEGORIES}”. Placing your value choices in all capital letters seems lock it in to the LLM that it should not deviate outside those choices.
For my purposes it seems to do quite well but at the cost of token inputs to classify single elements in a screenplay where I’m trying to identify the difference between various elements in a scene and a script. I’m sending the whole scene text with the extracted elements (which have been extracted by regex already due to the existing structure but not classed yet) and asking to classify each element based on a few categories. But then there becomes another question of accuracy.
For sentence or paragraph analysis that might look like the ugliest, and horrendous looking “{blockOfText}” = {type: object, properties: {sentimentAnalysis: {type: string, description: “only choose from {CATEGORIES}”}}. Which is unfortunately not the best looking way but it works.
Whereas I felt the opposite the of Reddit. I cut out Reddit completely during that last debacle and I would say my life is better for sure.