Blogs

A collection of blogs and likely shared out with the community as an open source project.

Setup Cloudflare Tunnels to your home server

Setup Cloudflare Tunnels to your home serve Everything you need to know to get securely connect to your locally hosted application over the internet in under 30 mins. At the high level, I’m running a SimpleHTTPServer locally, that i want to access over the internet from https://home.mydomainname.com Secondly, I’ll lock down the access to this URL to whitelisted email addresses. Setup Cloudflare Tunnels to your home serve Prerequisites Local Setup cloudflared Download install Authenticate Setup tunnel create credential file create config.

March 30, 2023

Resume

Robin Varghese Whatever the problem, I want to be part of the solution. I enjoy developing software and empowering others in my knowledge space. I bring 10+ years of Full-Stack Developer experience and 5+ years of Leadership experience. I thrive in an environment of uncertainty which requires constant learning. Reach Me Github LinkedIn Email Say Hello . . . . Knowledge space Tech stack Interests Languages Tools Databases Platforms Full-stack Development Python Jupyter BigQuery Google Cloud Platform Data Science, Analytics SQL django AWS Athena docker Machine learning pandas plotly mySQL Airflow Generative AI React.

March 16, 2023

i love adirondacks

i love adirondacks To assist me in planning a unforgettable getaway with our family and friends, I made a list of some of the best things to do in the Adirondacks. Places Whiteface Veterans’ Memorial Highway website - wikipedia youtube Driving up to the top of the Whiteface along the Veterans’ Memorial Highway—New York’s fifth-highest peak at 4,867’—isn’t your typical automotive experience. Whiteface Memorial Hwy, Wilmington, NY 12997 C42F+X3 Wilmington, New York

August 26, 2021

Single-threaded vs Multi-threading vs Multi-processing in Python

Single-threaded vs Multi-threading vs Multi-processing in Python jupyter notebook link We will try to run a few simulated processes to understand the performance difference between Single-threaded, Multi-threading and Multi-processing in Python. We will learn about GIL - Alternative Python interpreters - by counting to 255 million and downloading few webpages import concurrent.futures import requests import threading import time import math import random from multiprocessing import Pool # Reference and Credits # https://realpython.

December 15, 2020

USPS API Proof of Concept

USPS API Proof of Concept jupyter notebook link I was hoping to demostrate how one can pull tracking information from USPS API endpoint for a given tracking ID. Acknowledgements all documentation was available on this webpage https://www.usps.com/business/web-tools-apis/track-and-confirm-api.htm#_Toc41911504

December 15, 2020

Intro to SQL with 5000 movies

Intro to SQL with 5000 movies jupyter notebook link This notebook is a part of a talk i have been giving to introduce people to SQL. Only pre-requisite to attend this talk is some general curiosity. Acknowledgements This dataset was generated from The Movie Database API. This product uses the TMDb API but is not endorsed or certified by TMDb. We used the dataset published on kaggle that includes 5000 movies

November 28, 2020

SQL upsert loader

Overview of SQL upsert loader jupyter notebook link source code I hope to present a Proof Of Concept version of a multiprocessed data loader that I use extensively in my data integration pipelines. Couple of problems that it is attempting to address are Ability to operate on any update flat file associated with a SQL table, with minor configuration. Ability to perform upsert operations on datasets without a primary key column.

November 28, 2020

Analytics Commons Talk

I gave this talk to give an overview of few tools that our department relies heavily on. This talk was part of our IS department’s commons session to give employees the chance to share their skills with examples to set and follow. Top 5 tools Analytics uses Introduction We are hoping to give an insight into 5 tools that we rely heavily to make our life easy in Analytics department.

November 5, 2020

Jupyter - Hello world

4 Jupyter jupyter notebook demo link 4.a Introduction Project Jupyter is three things: a collection of standards, a community, and a set of software tools. Jupyter Notebook, one part of Jupyter, is software that creates a Jupyter notebook. A Jupyter notebook is a document that supports mixing executable code, equations, visualizations, and narrative text. Specifically, Jupyter notebooks allow the user to bring together data, code, and prose, to tell an interactive, computational story.

October 5, 2020

Maestro Job Engine Architecture

Maestro Job Engine Architecture +---------------------------------------------------------------------------------------------------------------------------------------------------------------+ | | | | | Maestro Job Engine Architecture | | | | | | | | +---------------------------+ | | | | | | | execute 1 | | | | | | | +---------------------------+ | | | | +---------------------------+ +------+----------+--------+--------------------------------------+-------------+ | | | | push logs to Database | date | job_name | status | tags | debug_data | | | | logging 2 | +---------------------> +-------------------------------------------------------------------------------+ | | | | | | | | | | | | +---------------------------+ | | | | #frequency #type #priority #author | | | | | | | | examples | | | | +---------------------------+ | | | | #daily #etl #critical #robin | | | | | | analyze logs | | | | #weekly #test #minor #bart | | | | | monitoring 3 | <---------------------+ | | | | #hourly #API #monitoring #dev #paul | | | | | | | | | | | | | | +----------+----------------+ +------+----------+--------+--------------------------------------+-------------+ | | | | | | | | | | | | notification | | | | | v | | +----------+----------------+ | | | | | | | Errors | | | | critical: 0 | | | | minor: 1 | | | | warning: 12 | | | | test: 1 | | | | dev: 5 | | | | success: 150 | | | | | | | +---------------------------+ | | | | | | | +---------------------------------------------------------------------------------------------------------------------------------------------------------------+

January 1, 0001

ha (刃, edge) - the tempered cutting edge of a katana. Scorecard metrics measurement OLAP cube sits Scorecard critical performance information on a single screen so users can monitor results in a glance.

January 1, 0001
Build with Hugo and other OSS