EPISODE 107 #meteor
Meteor Cloud Is a Full Service Hosting Solution for Meteor Apps
with Filipe Névola
EPISODE 106 #rails
CompanyCam Helps Contractors Document Their Job
with Chad Wilken
EPISODE 105 #flask
TinyPilotKVM Lets You Remote Control Your Server from Your Browser
with Michael Lynch
EPISODE 104 #rails
uscreen Is a Platform That Helps Content Creators Build a Business
with Nick Savrov
EPISODE 103 #rails
Great Question Makes It Easy for Teams to Perform Customer Research
with PJ Murray
EPISODE 102 #rails
Robot Accounts AI Provides a System to Let You Categorize Invoices
with Josh Kinabrew
EPISODE 101 #rails
Fundraze Is a Flexible Fund Raising and Campaign Management Service
with CJ Avilla
EPISODE 100 #jekyll
Running in Production Is a Podcast Where Devs Chat about Tech Stacks
with Nick Janetakis
EPISODE 099 #rails
A Custom Electronic Medical Record System for an Ophthalmology Clinic
with Jason Swett
EPISODE 098 #rails
Games Directory Lets You Sync Your Games and Achievements in 1 Place
with Vlad Radulescu
EPISODE 097 #rails
School Bus Hero Helps School Bus Drivers and Aides Find a Job
with Dieter Lunn
EPISODE 096 #rails
Hitobito Helps You Manage Communities with Complex Group Hierarchies
with Matthias Viehweger
EPISODE 095 #koa
Submotion Helps You Manage Access Control for Your SAAS Subscriptions
with Kristian Dupont
EPISODE 094 #django
HorseRecords Lets You Record Everything about Your Horses
with Andy Ide
EPISODE 093 #rails
Politico Europe Is a Business to Business News and Data Service
with Karl Roos
EPISODE 092 #akka
Couchmate Is a Social Chat Platform for Viewers of Live TV
with Matt Oliver
EPISODE 091 #ansible
Managing 40+ Servers in a Data Center at a Medical University
with Maciej Delmanowski
EPISODE 090 #rails
Avo Is a Framework for Creating Ruby on Rails Admin Panels
with Adrian Marin
EPISODE 089 #express
Optidash Is an Image Processing and Optimization API
with Przemek Matylla
EPISODE 088 #fastapi
CourseMaker Is an Online Course Builder for Technical Makers
with Chris Samiullah
EPISODE 087 #phoenix
Statuspal Is a Service for Hosted Status Pages and Monitoring
with Eduardo Messuti
EPISODE 086 #node
QA Wolf Helps You Create Automated Browser Tests as You Use Your Site
with Jon Perl
EPISODE 085 #rails
ListenAddict Lets You Subscribe to a Person Like You Would to a Show
with David Parker
EPISODE 084 #phoenix
PriceTable Mixes in Sales Automation, Project Management and Invoicing
with Ege Ersoz
EPISODE 083 #express
SongRender Lets You Create Audio Visualizer Videos from Audio Clips
with Jake Lazaroff
EPISODE 082 #pylons
Dropbox Gives You Secure Access to All of Your Files
with Utsav Shah
EPISODE 081 #jupyter
Mito Is a JupyterLab Extension to Make Python Data Analysis Easy
with Nate Rush
EPISODE 080 #laravel
10Web Is an Automated WordPress Hosting Platform
with Tigran Nazaryan
EPISODE 079 #golang
NanoVMs Let You Run Your Apps Faster and Safer with Unikernels
with Ian Eyberg
EPISODE 078 #flask
AbstractCRE Helps Extract Key Data from Real Estate Property Documents
with Cole Simmons
EPISODE 077 #rails
Podia Has Everything You Need to Sell Online Courses
with Jason Charnes
EPISODE 076 #django
Building an Internal App to Track 1,200+ VMs and Servers at REI
with Sean Callaway
EPISODE 075 #django
Password Space Is a Password Manager for Families
with Nick Hnatiw
EPISODE 074 #laravel
Pod Hunt Helps You Find Great Podcast Episodes to Listen To
with Mubashar Iqbal
EPISODE 073 #django
Joyful Gifts Is an Automated Gift Giving Service
with Jonathan Adly
EPISODE 072
This Episode Was Removed Because It's under Review
with Anders Hovmöller
EPISODE 071 #rails
DNSimple Is a Simple and Secure Domain Management Service
with Anthony Eden
EPISODE 070 #django
Buttondown Lets You Build, Grow and Launch Your Email Newsletter
with Justin Duke
EPISODE 069 #django
An Internal Financial Planning Service for Season Ticket Holders
with Denis Stepanenko
EPISODE 068 #phoenix
TextDB Is a Simple Way to Share Small Amounts of Data
with Ian Davidson
EPISODE 067 #django
Muze Is a Freeform iOS Chat Application
with Dash Winterson
EPISODE 066 #flask
MixedCRM Is a Sales and CRM Tool for Real Estate Property Developers
with Nidal Alhariri
EPISODE 065 #django
CareerVillage Is a Community Where Students Can Get Career Advice
with Jared Chung
EPISODE 064 #phoenix
Stacker Is an Internal Tool to Stitch Together Microservices Responses
with Sascha Wolf
EPISODE 063 #phoenix
Changelog.com Is a News and Podcast Platform for Developers
with Jerod Santo & Gerhard Lazu
EPISODE 062 #express
Browserless Gives You Fast, Scalable and Reliable Browser Automation
with Joel Griffith
EPISODE 061 #phoenix
Monitor Oban Jobs in Real Time with Oban Web Pro
with Parker Selbert
EPISODE 060 #flask
Fantasy Football Data Pros Teaches You Python through Fantasy Football
with Ben Dominguez
EPISODE 059 #django
Creative Hire Helps Match Designers and Companies to Various Jobs
with Kshitij Sinha
EPISODE 058 #django
Brightpath Is a Formative School Assessment Tool
with Kye Russell
EPISODE 057 #django
Crowdbotics Is a React Native + Django App Builder / Deployer
with Anand Kulkarni
EPISODE 056 #django
Divio Is a Cloud Platform for Managing Web Applications
with Daniele Procida
EPISODE 055 #django
Daughterly Care Is a CRM to Help Care for the Elderly
with Barton Ip
EPISODE 054 #django
Paparazzi Accessories Is an E-commerce Store That Sells Jewelry
with Dan Purcell
EPISODE 053 #django
An Inventory Management System for an E-commerce Platform
with Galen Rice
EPISODE 052 #express
A Video Course Platform Built for a Course Called Modern DevTools
with Umar Hansa
EPISODE 051 #django
An E-commerce Site That Lets Folks Buy Online Courses
with Dalton Polhill
EPISODE 050 #django
Tracking Games Played on a Flight Simulator
with Paul Cappaert
EPISODE 049 #django
Collecting and Processing Genomic Data to Help Cure Rare Diseases
with Dan Kolbman
EPISODE 048 #django
Social Hiring Platform for the Food and Beverage Industry
with Colin McFaul
EPISODE 047 #django
A Platform to Buy Gift Cards for Eco-Friendly Products
with Antonin Grêlé
EPISODE 046 #flask
Custom Hardware to Provide Affordable Email to the African Congo
with Clemens Wolff & Shaun Bathgate
EPISODE 045 #django
Skillwell Is a Video Platform That Helps You Unlock Physical Skills
with John Debs
EPISODE 044 #django
An Internal Employee Management App Focused on Schools
with Chris Goodwin
EPISODE 043 #django
DataWellness Helps Organizations Stay Safe and Compliant
with Dave Merwin
EPISODE 042 #golang
Creating a Video Course Hosting Platform to Learn Go
with Jon Calhoun
EPISODE 041 #django
Litt NYC Lets You Easily Find Friends and Things to Do
with Harry Moreno
EPISODE 040 #django
A Site to View 3D Scans of Cars with Twinner
with Jesse Hunt
EPISODE 039 #django
Place Card Me Lets You Create Printable Place Cards Online
with Cory Zue
EPISODE 038 #django
The CMS Front End for Lionel Trains' Products
with Mark Miscavage
EPISODE 037 #django
A Real Estate Order and Appraisal System for a Small Business
with Austin Lewis
EPISODE 036 #django
Passiv Is a Portfolio Management and Automation Platform
with Brendan Wood
EPISODE 035 #static-site
Determine What Your Toilet Paper Supply Is Based on Your Usage
with Ben Sassoon
EPISODE 034 #django
Confectionery Connect Is an E-commerce Video Course Marketplace
with Sean Parsons
EPISODE 033 #django
Zego Lets You Easily Buy Insurance by the Hour
with Stuart Kelly
EPISODE 032 #django
Building a Site Around Thousands of Diary Entries from Samuel Pepys
with Phil Gyford
EPISODE 031 #phoenix
Mux Is an API Based Platform That Lets You Process and Stream Videos
with Dylan Jhaveri
EPISODE 030 #flask
TradeRev Is a Machine Learning Vehicle Appraisal / Auctioning System
with Amit Jain
EPISODE 029 #flask
Cover Tuner Uses NLP to Help Improve Your Cover Letters
with Saad Malik
EPISODE 028 #dotnet
Easily Find, Reproduce and Track Your JavaScript Errors with TrackJS
with Todd Gardner
EPISODE 027 #python
A College Professor Self Hosts Jupyter Hub for His Students
with Peter Kazarinoff
EPISODE 026 #flask
Contextualise Is a Tool That Lets You Easily Organize Information
with Brett Kromkamp
EPISODE 025 #flask
A Cryptocurrency Powered E-commerce Store Called Strmline
with Ty Cooper
EPISODE 024 #rails
CovidNearMe Tracks Cases and Has Info for Citizens / Health Workers
with Scott Johnson
EPISODE 023 #flask
Taleas Is a Cute, Quirky, Random and Slightly Weird Webcomic
with Seth Black
EPISODE 022 #flask
Creating a Non-profit Food Ordering Service for Inner City Kids In LA
with Francisco Barcena
EPISODE 021 #phoenix
Get to Know Your Coworkers through Simple QA with This Slack App
with Adam Conrad
EPISODE 020 #flask
A Weather Analysis Service for Regular People and Meteorologists
with Nick Gregory
EPISODE 019 #phoenix
Hex.pm Is Elixir's Official Package Manager
with Eric Meadows-Jönsson
EPISODE 018 #phoenix
6DOS Helps You Explore Your Personal Network
with Henry Popp
EPISODE 017 #rails
Smart Music Helps Musicians Practice More Efficiently
with Julien Blanchard
EPISODE 016 #rails
VA.gov Provides an API to Get Information about Veterans
with Charley Stran
EPISODE 015 #express
Kernl.us Helps WordPress Plugin and Theme Developers Manage Updates
with Jack Slingerland
EPISODE 014 #phoenix
ScrollKeeper Is a Collaboration Tool for Researchers
with Ian Butler
EPISODE 013 #phoenix
Remote.com Helps You Find Remote Jobs Anywhere
with Marcelo Lebre
EPISODE 012 #rails
Learn Ruby on Rails through Screencast Tutorials on GoRails
with Chris Oliver
EPISODE 011 #phoenix
Logflare Is a Log Management and Event Analytics Platform
with Chase Granberry
EPISODE 010 #flask
ScholarPack Runs 10% of the UK's Primary Schools and Gets Huge Traffic
with Gareth Thomas
EPISODE 009 #golang
Load Balance, Secure and Observe Your Web Applications with Nova ADC
with Dave Blakey
EPISODE 008 #koa
Openship Is a Shopify App for Drop Shipping and Order Fulfillment
with Junaid Kabani
EPISODE 007 #dotnet-core
Discworld Disorganizer Is a Discworld Book Series Search Engine
with Jamie Taylor
EPISODE 006 #golang
Qvault Is an Open Source Tool to Manage Passwords and Crypto Keys
with Lane Wagner
EPISODE 005 #flask
EarlyBrd Alerts You of New Job Board Postings So You Can Bid Faster
with Stetson Blake
EPISODE 004 #django
Real Python Is One of the Largest Python Learning Platforms Around
with Dan Bader
EPISODE 003 #phoenix
Learn Elixir and Phoenix by Building Things Over at Alchemist Camp
with Mark
EPISODE 002 #rails
A Video Based AWS Certificate Training Platform Called Exam Pro
with Andrew Brown
EPISODE 001 #phoenix
Serving Medical University Employees, Health Officials and Students
with Gabriel "OvermindDL1" Robertson
EPISODE 000
Preview of What's to Come
Are you running a site in production? I'd love to hear your story, become a guest.
Qvault Is an Open Source Tool to Manage Passwords and Crypto Keys
- #golang
- #electron
- #acm
- #aws
- #cloudformation
- #cloudfront
- #cloudwatch
- #open-source
- #postgres
- #rds
- #route53
- #s3
- #serverless
- #travis-ci
- #vue
Lane Wagner
https://qvault.io/
In this episode of Running in Production, Lane Wagner goes over how he built Qvault which is an open source password manager that specializes in cryptocurrency. It’s built with Electron and has a Serverless component that uses Golang. It’s all hosted on AWS.
If you were ever wondering how Serverless works in the context of building a native or web application this episode has you covered. Lane talks about how a bunch of different AWS services all come together to make it work. We also talk about a Serverless framework called Serverless!
Topics Include
- 1:03 – Qvault is an Electron based password manager with a focus on cryptocurrency
- 2:16 – The focus has been a secure desktop app but a browser extension is coming soon
- 2:45 – Creating a secure browser extension without sharing your master key
- 3:12 – It’s an open source app, so if you’re skeptical you can compile it yourself
- 3:46 – Motivation for using Golang for the Serverless component
- 5:00 – For personal projects learning something new (Serverless) is worthwhile
- 5:48 – The TL;DR on what Serverless is and how it works
- 6:49 – AWS API Gateway helps map Serverless functions to HTTP requests
- 7:05 – Instead of 1 app with many routes, you have many individual functions
- 7:50 – A Serverless framework called Serverless helps tie everything together
- 8:33 – Tying in a Serverless function to a specific URL endpoint
- 9:25 – Calling these URL endpoints from the Electron app is like any other REST API
- 10:40 – What’s being executed within these Serverless functions?
- 11:12 – When it comes to Bitcoin and cryptocurrencies, it’s all about privacy and security
- 12:13 – Passwords are encrypted client side in the Electron app
- 13:17 – Encrypted vault file gets saved client side and it’s optionally saved server side too
- 14:01 – This data is stored inside of PostgreSQL using RDS within AWS
- 14:20 – Electron app -> API endpoint -> Serverless function -> data gets written to Postgres
- 14:49 – Using a managed database vs managing your own database
- 15:28 – The developer / development experience for writing Serverless functions
- 17:41 – When hacking on a new Serverless function, it just gets pushed to production
- 18:37 – The 2 biggest Serverless wins are function isolation and scaling auto-magically
- 18:56 – Serverless scales to the size of your wallet
- 19:21 – But it also costs nothing if no one is using it
- 20:02 – The turn around time for AWS to spin up an environment to run a Serverless function
- 20:35 – Function warming helps keep spin up times to milliseconds
- 21:44 – There are tricks to keep your functions warm to avoid a multi-second spin up time
- 22:21 – For Qvault’s API, response times were never a problem partly due to using Golang
- 22:53 – The Electron app is written in JavaScript using Vue
- 23:28 – Electron is basically a browser bundled with a specific JavaScript app
- 23:56 – Electron apps can be pretty bloated but it’s super convenient to develop with
- 24:45 – On Arch someone made a package that tries to use what you have installed already
- 25:43 – A recap of which AWS services are being used
- 26:02 – Using Route 53 on AWS for DNS hosting saves a lot of headaches
- 27:15 – Wait, how is CloudFront (Amazon’s CDN) being used on the back-end?
- 28:24 – It’s not, but CloudFormation is (it’s so easy to mix up AWS service names!)
- 28:33 – The TL;DR on what CloudFormation is, how it’s being used and why it’s useful
- 29:29 – Serverless framework converts platform agnostic configs into platform specific configs
- 30:03 – CloudFormation is especially handy for Serverless due to the number of endpoints
- 30:44 – Every Serverless endpoint is being served over HTTPS with Amazon’s ACM SSL certs
- 31:31 – There are no external software as a service dependencies besides what’s on AWS
- 32:04 – For logging, error reporting and metrics it’s all AWS services
- 32:36 – Getting logs from a Serverless function involves using CloudWatch and S3
- 32:53 – One nice thing about Serverless is there’s no long running state
- 33:45 – Strategies for dealing with database migrations with a Serverless set up
- 34:53 – Dealing with long running migrations that surpass AWS Lambda’s 15 minute timeout
- 36:41 – Lane is a big fan of CI / CD and the master branch always matching production
- 37:13 – A CI pipeline is being used for the Electron app with Travis CI
- 37:28 – The Electron app has an auto-update function to check for updates on demand
- 38:09 – The Serverless side of things doesn’t change much and there is no CI pipeline
- 38:42 – The turn around time is nearly instant for a new function version to take effect
- 39:59 – The Serverless framework sets environment variables for secret / sensitive values
- 41:01 – The work flow for changing a sensitive value to an existing Serverless function
- 43:18 – Dealing with disasters and malicious users
- 44:00 – Qvault hashes passwords before it’s sent to the server
- 45:50 – Running all of this on AWS costs in between $20 and $30 / month
- 46:36 – On AWS it’s easy to upgrade to a larger instance size but it’s hard to downgrade
- 46:42 – The RDS instance is running on a
t2.micro
since the DB is very simple - 47:34 – Most of the app’s complexity is client side in the Electron app
- 48:10 – There’s 53k+ lines of code but that includes the
node_modules/
directory - 48:37 – The app itself has about 3-5k lines of code across ~40 files
- 49:01 – The complexity being on the front-end is necessary due to security requirements
- 49:32 – Lessons learned? Serverless couples your app logic to your provider, it’s not great
- 50:48 – There’s a lot of DevOps complexity where you trade 1 ops problem for another
- 51:25 – But Serverless is likely easier to set up than an entire Kubernetes cluster
- 51:39 – That being said, Serverless is very cost effective for low traffic APIs
- 52:12 – Lane would likely choose Serverless again for his specific use case
- 52:29 – Another nice thing about Serverless is not having to worry about scaling up
- 53:08 – Should you use Serverless for a traditional web application?
- 53:46 – It really depends on what you care about, such as cost vs development speed
- 54:16 – Serverless can get really expensive at larger scale (more so than regular hosting)
- 55:39 – You can find Lane on Twitter at @wagslane and his app can be found at qvault.io
Links
📄 References
- https://en.wikipedia.org/wiki/Serverless_computing
- https://en.wikipedia.org/wiki/Cryptocurrency
- https://en.wikipedia.org/wiki/Bitcoin
- https://serverless.com/
- https://en.wikipedia.org/wiki/Representational_state_transfer
- https://docs.aws.amazon.com/IAM/latest/UserGuide/id_users.html
- https://serverless.com/blog/keep-your-lambdas-warm/
- https://en.wikipedia.org/wiki/List_of_DNS_record_types
- https://linux.die.net/man/1/kill
- https://www.postgresql.org/docs/current/functions-json.html
- https://medium.com/coryodaniel/from-erverless-to-elixir-48752db4d7bc
⚙️ Tech Stack
- golang →
- electron →
- acm →
- aws →
- cloudformation →
- cloudfront →
- cloudwatch →
- open-source →
- postgres →
- rds →
- route53 →
- s3 →
- serverless →
- travis-ci →
- vue →
Support the Show
This episode does not have a sponsor and this podcast is a labor of love. If you want to support the show, the best way to do it is to purchase one of my courses or suggest one to a friend.
- Dive into Docker is a video course that takes you from not knowing what Docker is to being able to confidently use Docker and Docker Compose for your own apps. Long gone are the days of "but it works on my machine!". A bunch of follow along labs are included.
- Build a SAAS App with Flask is a video course where we build a real world SAAS app that accepts payments, has a custom admin, includes high test coverage and goes over how to implement and apply 50+ common web app features. There's over 20+ hours of video.
Questions
- Want to discuss this episode on Twitter? Tag @nickjanetakis or @wagslane
Dec 09, 2019
✏️ Edit on GitHub