I think many here miss totally the point. Is the same mindset that lead to believe C, bash or unix are good(?) then why bother?
I'm very lucky that I start with FoxPro, so I know what is to live with a MUCH better thing than SQL.
To the point:
- "SQL is standard, everywhere... why try to change or do something else?"
I hope none here work in new software products.
And also, try to replace ALL the OLD with the NEW is no the point, is to try to DO BETTER THAN THE OLD.
I suspect most of use are in that business... right?
- "SQL is a good language!"
Superficially, yes.. as good is javascript or C. More exactly to be the "default" option we are VERY lucky SQL is not alike C or JS. But "good" is not. Is adecuate.
IF you DON'T KNOW WHY then learn the why first. For us that LIVE in the RDBMS world is clear as water than SQL is not the ideal, is what we have.
----
Is important to understand that "SQL", Rdbms and the relational model are badly misunderstood (just look how the NoSql movement market itself!)
- SQL IS NOT THE RELATIONAL MODEL, is BASED on it.
The relational model is MORE expressive, powerful, flexible and EASIER than SQL.
- SQL IS NOT RDBMS
A much better APIs can be build on top a RDBMS but SQL is a poor language for that. This is part of why exist so many extensions.
Think, for example, why you can't do
SELECT key FROM BTreeInde_CustomerCode
GROUP BY (whatever -- And I mean GROUP, not SUMMARIZE!)
let city = SELECT name
let filter = WHERE id = @id
let query = city + filter(id=1)
and many many other things like that
Many things that get mixed with the "SQL" language are part of the implementation or capabilities of the RDBMS.
- However, SQL IS A FINE EXAMPLE IN HOW DO DATA
And in fact, is not that hard to imagine a much better version, SQL is not that far from a better option!
I worked as a Foxpro programmer for 18 years. I later switched to the Clojure language for 8 years. I used the functional programming language Clojure as SuperFoxpro, which is very easy to use and enjoyable. I has formed a new programming idea ---- `Everything is Foxpro (RMDB)`. ;-)
I advocate: Building a relational data model on top of hash-map to achieve a combination of NoSQL and RMDB advantages. This is actually a reverse implementation of posgtresql.
let city = SELECT name
let filter = WHERE id = @id
to
let city = map name
let filter = filter(id = id)
let query = city |> filter
this is to show that SQL, despite being a programming language, can't compose well.
The syntax is not the point.
You can build full apps in forth or lisp (as examples of even more minimal Langs than SQL) but now consider the idea of build a full app in SQL. Without other language making the rest of their limitations.
You’re asking me to consider the idea of building a full app in SQL. I would ask you - why?
SQL wasn’t designed nor ever meant to be able to write a full app. You’re expecting it to do something it wasn’t designed to do. Because it is a programming language doesn’t necessarily mean it ought to be able to solve any kind of problem.
I personally don’t think SQL is all that great, for various reasons (lack of standardization with various dialects and their own gaps or abilities).
Optimally, you'll want to build your full app in a single language, frontend, data queries, everything. That eliminates every problematic interface where you have to re-encode values, verify types and other invariants, connect different runtimes, abstract foreign behavior, etc. (Somehow the JS developers talking about isoiconicity only cite code reuse... And the Lisp ones focus on metaprograming.)
We have a variety of good application languages, so it's a safe bet that one can create a not horrible one; we also have a few standards for IPC and some very safe literature on how to integrate them with a language. Foreign interfaces are always iffy, but it's also settle how to create a not horrible one. The most risky part is data querying, so it makes sense to start with a proven implementation here.
> You’re asking me to consider the idea of building a full app in SQL. I would ask you - why?
"We Can Do Better Than SQL"
And the fact that some can't imagine to build a full app in SQL (not as is TODAY but as could BE) is sad.
I live in that world before. With the base/foxpro familia's you can totally build a full app with a database language, in fact, easier than with python.
---
The point here is that obviously, SQL is not mean for programming, but do one-off queries here and there. But it not exist a reason to aim higher.
BTW, part of the laments of the creators of the relational model is that SQL have ruined, like COBOL, the mind of millions of developers.
>”And the fact that some can’t imagine to build a full app in SQL is sad”
You are outlining some general purpose programming language that allows querying, information retrieval, maybe declaratively or functionally or using objects? I don’t know - you provide no other details.
How expressive would this language be? What abstractions would it provide out of the box? How expressive is it? Your examples allow some code reuse via naming/aliasing specific clauses... is that it?
Specifically what apps would it allow someone to build? And what trade offs result from those decisions? Is it better suited for mathematical operations or data science vs building general enterprise applications? There’s a difference. Is it interpreted like SQL? Would it need to be compiled?
You’re doing a lot of handwaving, and when pressed for details, you respond with a thinly veiled insult - the problem is with the reader or me specifically for not being able to read you mind. We should take you at face value without question.
> You are outlining some general purpose programming language that allows querying, information retrieval, maybe declaratively or functionally or using objects?
Yes. That is the mindset in see how "Do Better Than SQL".
> How expressive would this language be?....
As expressive as any other. By coincidence I'm building a relational lang as side project but my post was more about think in how SQL limitations can be lifted.
If all is just "sql is only for data retrieval" then is not much else to add than just spice the syntax, maybe.
> You’re doing a lot of handwaving, and when pressed for details, you respond with a thinly veiled insult
That is not my intention. When I said "Some can’t imagine to build a full app in SQL is sad" I mean in general. I think that that will sound bonkers as say "build an app with xml" or similar. But the point of this post is about how be beyond what sql is.
----
A bit more details, now that you ask for more. My idea is revive the spirit of the dbase family of languages. There, you don't need ORMs, build a database app is alike build any other and the language was powerful enough to not need any else for the majority of their users.
The main abstraction is the "relation" that look at data not as scalar or simply lists, but as SCHEMA + DATA:
city = [name:str, state:str; "Miami", "Fl"]
schema data
And because all values are relations, everything can be "queried":
[1, 2, 3] ?where #value == 1 //show [1]
[1, 2, 3] ?union 4 ?join city.id ?sort #name
for i in File.open("...") ?where empty(#line) == false do
etc. Is like LINQ? Yes. Where it differ from "just use LINQ, duh!" is that almost all languages are "scalar is first class, but collections not". Instead the relational model operate on sets/collections and all can be generalized for 0, 1 or many values.
All of this is without talking about storage. Is just a regular language with regular stuff. In my case I'm working in an interpreter, inmutable first, structural types. made in rust:
Agreed with the sibling. Large chance I have just missed your goal.
It may help to expand on your proposal. For example, what do you mean with group by, but not summarize? The group by clause says nothing about how to combine data not in the group. That has to be on the select. And I have yet to find a solution that beats ROLLUP for giving a great overview of data.
About the only thing that sucks on the current syntax is that it is not possible to get auto complete in the select, without having some from.
This feels like a misunderstanding of SQL. It is not a programming language. It is a data selection language.
And group by does work the same as other languages. However, you can't talk of the group by without the select. So, if you use count, or sum, or max, or ..., Yes it will be a summary. You can use string_agg or friends if you want all values. But... Probably safer to get each as a row.
SQL is a programming language. Is just too limited and that is why many can't imagine to use it for a full project.
But that limitations have no sense. The amount of code, time and efficiency that bring is huge (I know, I code in that kind of lang before) and is discussed in:
In special look a point 5/6 of Summary. The irony is that we already have a "solution"(sql) to the whole problem, but is too limited and awkward to be used in practique.
I'm not sure why, but this post was hard for me to follow. The linked article is borderline incoherent to me.
What gets me, is even in languages where I'm not working with a relational database, the API for selecting data almost always drifts to something akin to SQL. To the point that I cringe if someone tries to force a new API.
Because the poor formatting and example (making the code look too much as sql!), some nuance was lost. Consider instead:
let keys = SELECT key FROM BTreeIndex_CustomerCode;
let city = SELECT name;
let groups = GROUP BY (whatever -- And I mean GROUP, not SUMMARIZE!);
let filter = WHERE id = @id;
let query = city + filter(id=1);
for city in query GROUP BY keys
....
I think many here miss totally the point. Is the same mindset that lead to believe C, bash or unix are good(?) then why bother?
I'm very lucky that I start with FoxPro, so I know what is to live with a MUCH better thing than SQL.
To the point:
- "SQL is standard, everywhere... why try to change or do something else?"
I hope none here work in new software products.
And also, try to replace ALL the OLD with the NEW is no the point, is to try to DO BETTER THAN THE OLD.
I suspect most of use are in that business... right?
- "SQL is a good language!"
Superficially, yes.. as good is javascript or C. More exactly to be the "default" option we are VERY lucky SQL is not alike C or JS. But "good" is not. Is adecuate.
IF you DON'T KNOW WHY then learn the why first. For us that LIVE in the RDBMS world is clear as water than SQL is not the ideal, is what we have.
----
Is important to understand that "SQL", Rdbms and the relational model are badly misunderstood (just look how the NoSql movement market itself!)
- SQL IS NOT THE RELATIONAL MODEL, is BASED on it.
The relational model is MORE expressive, powerful, flexible and EASIER than SQL.
- SQL IS NOT RDBMS
A much better APIs can be build on top a RDBMS but SQL is a poor language for that. This is part of why exist so many extensions.
Think, for example, why you can't do
and many many other things like thatMany things that get mixed with the "SQL" language are part of the implementation or capabilities of the RDBMS.
- However, SQL IS A FINE EXAMPLE IN HOW DO DATA
And in fact, is not that hard to imagine a much better version, SQL is not that far from a better option!