Hacker News new | past | comments | ask | show | jobs | submit login
Show HN: Pipedream 2.0 – AWS Lambda + Zapier alternative (pipedream.com)
115 points by todsacerdoti on April 7, 2022 | hide | past | favorite | 39 comments
Hey HN! Pipedream is an integration and compute platform purpose-built for developers building workflows and connecting cloud services.

You can author workflows without writing any code: Pipedream supports over 700 integrated applications (GitHub, Slack, etc) [1] and all connectors are open source [2]. In addition, you can write any Node.js, Python, Go, or Bash code within workflows, extending the pre-built integrations with your own custom logic.

Since we launched Pipedream on HN [3], over 300k developers have used the product. Pipedream developers tell us consistently that they love the code-level control when they need it, and the built-in, no code integrations when they don't. But we’ve also heard consistent feedback that the product needed to be easier to use, support more language runtimes, and provide a native Git integration.

In Pipedream v2, we have re-imagined the entire product and key features, including:

- Multi-language support including Node, Python, Golang, and Bash - Data Stores to store and retrieve data across steps & workflows - Open source triggers and actions for 700+ applications - Improved workflow builder to test and iterate without impacting live workflows - Multiple triggers are now supported per workflow - Improved forms and testing for rapid step-by-step development

We’re working on a GitHub integration now, which will let you manage workflow definitions as code. You can still use the Pipedream UI to author workflows, and use Pipedream’s pre-built integration components to build integrations, but you’ll be able to serialize those workflows to code. Think Terraform or CDK for app integrations. You can sign up for our waitlist below. [4]

My cofounder @dylburger and I will be here to answer any questions.

[1] Explore our integrations - https://pipedream.com/explore

[2] GitHub - https://github.com/PipedreamHQ/pipedream

[3] Alpha launch on HN - https://news.ycombinator.com/item?id=21270424

[4] Sign up for early access to GitHub integration - https://pdrm.co/git




Congrats on the 2.0 release! Python support and the key/value store is super cool to see.

Recently used Pipedream very successfully on a freelance gig to create a search widget powered by a client-editable Airtable base that auto-feeds into an Algolia index.

I'm excited to play around with v2, have been promoting Pipedream in my little Discord community of scrappy devs. Best wishes on your continued success.


@davidfactorial - thanks for sharing your use case and we look forward to hearing your feedback on the 2.0 release with Python support. we continue to be amazed but how many users are building automations with Discord and we appreciate your sharing the product with your scrappy dev community!


@davidfactorial, curious to hear more about your Discord! I'm a scrappy dev myself :)


sure - email or tweeter me, links are in my profile


Thank you for mentioning algolia. Big fan (and users) of both and you just gave me an idea...


This is looking good, will have to give it a try. I’ve tried using zapier multiple times over the years and always found it a bit too simplistic.

This looks like it may be in the sweet spot of flexible enough to do something more advanced, but would save me the effort building out the integration steps manually.


The ability to use even a small amount of arbitrary code really increases the utility for me


David - we often use the phrase "code when you need it and no code when you don't." obviously that is easier said than done but we do see tremendous power in a platform that allows you to write a small amount of arbitrary code while having access to an entire registry of thousands of pre-built integrations.


Zapier does allow python and JavaScript code to be run as a step in zaps.


I'm surprised you've kept the name pipedream for so long, considering the fact it is also a brand of adult toys makes searching the word pipedream not exactly "safe for work"


We are #1 in most searches now but we do see an occasional image which can be surprising. We love the name so it’s not changing!


I would be prepared if I were you, since if someone like Microsoft can loose the name Skydrive to a news station, I think your odds against a nearly 50 year old company probably aren't good


Wow, wow! I think this may shave dozens of hours off a few workflows I've recently been scoping for a new project. I'm gonna start playing with this tonight.

How have I not heard of you before?


Tiny grammatical error on the docs page (https://pipedream.com/docs)

The last sentence of the Open Source section reads: "You can also create a PR contribute new or enhanced components via GitHub."

Probably should read, "You can also create a PR and contribute new or enhanced components via Github."



Question! This sounds amazing, however it's not clear if the free tier is 10k/month or if after 10k in total (globally), the account will be "disabled permanently" until starts paying.

Personal request: can you provide a low cost tier for personal usage? I love the idea, but the number of invocations I'm talking about is probably around 200/month (for family related stuff), I can't justify paying 20$/month for that to my wife


It is 10k per month with a daily cap on the free tier. See pipedream.com/pricing.


Thank you, I looked at the pricing but the "per month" is near the dollars in all the plans (e.g. $19/month), so the "Free" tier doesn't have the word "month" anywhere, hence my question


We corrected this, and I think it's a lot more clear now. Thanks for mentioning!


Got the email so I must have signed up before. Demo video looks awesome! Just some feedback, when I visited the site on my mobile, I scrolled down, and it scrolled horizontally with weird widths, which made it feel not tested on mobile, plus the menu hamburger didn’t work, so I couldn’t find the pricing, and it made me reconsider whether I’d rely on this in production. For reference, I’m on iOS Firefox (which is basically safari).


The fix for the broken hamburger menu on mobile should be out, thanks again for raising.

You can see our pricing at https://pipedream.com/pricing and a deeper overview / FAQ here: https://pipedream.com/docs/pricing/


Thanks! The horizontal scrolling issue looks fixed. Unfortunately, though, the hamburger menu still isn’t working, and strangely it looks as if whole site is rendered twice?

Here’s a video: https://imgur.com/5jhbouf


We are shipping a fix for this right now! Really glad you noted this. Will let you know when it's out.


Remember seeing this a few years ago and love the idea of "zapier but for developers". Having just been building our Zapier integration, I'm think i'm even more of a fan of the concept. Zapier is so clicky and feels so limited. (and expensive if we were to encourage our customers to use it!)

Can I make an integration for others? Or is that stuff all done by your team?


Sorry for the delay. You can make an integration for others! See https://pipedream.com/docs/components/guidelines/#process .

We do a little work to create the shell of the app integrations, e.g. we add the logo, for OAuth apps we configure the details of the OAuth authorization / refresh process, etc. Then you can develop any sources or actions for the app and publish them for all Pipedream users.

The best place to chat is on our public Slack or GitHub, if you're interested. See https://pipedream.com/support .


Used this for a project recently - made things remarkably easier than writing all the code myself.


Thanks for your feedback. Ideally, you should only need to write the code that is unique to your use case and the rest of the code should be provided to you. We are working hard to continue building out the marketplace of integrated apps and please keep the feedback coming.


Getting 404 on this page - https://pipedream.com/code/python/


Named after the classic Amiga game I hope? :)

https://www.mobygames.com/game/amiga/pipe-dream


I wish the workflow engine itself was open source too as it would be a better alternative to n8n.


I hear you! We're tracking this in a couple of issues:

1. We plan to publish an execution environment (as a container) that simulates the core Pipedream runtime. You could run this locally or as a container on whatever container service you'd like. 2. We get a lot of requests for a fully-self-hosted / open-source version, and we're considering how to approach that as well.

Please follow the issues below, and let us know if you have any more feedback!

[1] https://github.com/PipedreamHQ/pipedream/issues/1635 [2] https://github.com/PipedreamHQ/pipedream/issues/954


Cool. Hope it comes to fruition.

My other pipedream in addition to this would be multi tenancy (including integrations).

A perfect world scenario is a drop in multi tenant zapier alternative that enables SaaS providers to either create workflows for their users so all they need to do is authenticate integrations for the most part or allow for them to build their own workflows from scratch.

I realize this is probably out of scope of the services aim but it doesn't hurt to throw it out there since all of the alternatives that exist are sorely lacking in various ways.


We hear this a lot from devs and we do plan to tackle it. I was building productivity tools (mostly for Gmail / Google Calendar) at my last startup and would have loved to have Pipedream manage OAuth / token refresh, kick off workflows on behalf of my users, etc.

If you're interested, join our community and you'll get early updates on stuff we're working on (GitHub integration, TypeScript / other new language runtimes, etc.): https://pipedream.com/support


Could you use OpenFAAS as an execution environment for the integrations/functions? This would allow you to run this without Lambda as well.


Yes we're thinking a lot about this. The vision would be let you execute workflows on whatever function runtime you use. So you'd have one definition of a workflow on Pipedream, but that could be serialized to e.g. a Google Cloud Function, an OpenFAAS function, etc. And you'd get to run it in your own VPC, with access to your own internal resources, without relying on Pipedream's infra.

Still in the idea phase, but let me know if that resonates.


Hey, I'm the maintainer of OpenFaaS. Thanks for mentioning the project.

Pipedream v1 ran on Lambda, but this post is touted as "AWS Lambda alternative", have you moved off the AWS Lambda platform?

I was curious how you added support for other languages, was it in the same way that you built-in support for Node.js? Where all the code gets effectively built into a single Lambda function and proxied?

For people who want to call OpenFaaS workloads from Pipedream, that's possible over HTTP and Pipedream makes that relatively simple. One thing I think they've really nailed is the OAuth integration, it just makes that whole painful flow a lot more convenient. I also like the editor and the way it infers what kind of input will go into the next step in a workflow.

Alex


Hey Alex!

We build our own containers and still run them on Lambda. The container base image contains the necessary language runtimes so that we can execute both Node.js and e.g. Python in the same workflow.

Do you think it would make sense to add an OpenFAAS integration to Pipedream? Then it would show up when users searched for it in workflows, and have a dedicated page at https://pipedream.com/apps . Even if we just end up wrapping HTTP requests to kick off a function, we've found it's helpful because users are often searching for FaaS platforms by name when they want to integrate with them in a workflow.


It does resonate, thank you!


Unable to watch video. Nothing happens when I click play or "watch now".




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: