updated docs

deepaksood619 · Dec 16, 2023 · 9b7ef17 · 9b7ef17
1 parent 8b8bf07
commit 9b7ef17
Show file tree

Hide file tree

Showing 26 changed files with 190 additions and 36 deletions.
diff --git a/docs/about-me/ideas/startups-ideas-saas.md b/docs/about-me/ideas/startups-ideas-saas.md
@@ -76,7 +76,7 @@ Online coding tool + Environment
 
 Free Coding test taking platform (Think exam but free)
 
-**Ecommerce for small businesses**
+### Ecommerce for small businesses
 
 - Mobile product scanner
 - Any business can be online just by capturing photos of product
@@ -103,15 +103,17 @@ Diet chart + what should I eat today along with recipe
 - Opensource
 - Bigger limits for collaboration using gitlab or something
 
+## Finance / Economics
+
 **Programmable currency, you can program the currency in a way that it can only be used for a certain thing like buying fertilizer by a farmer**
 
-**Smart Credit**
+### Smart Credit
 
 - Health Insurance money is paid by insurer directly to hospital (smart/programmable currency)
 - Whatever credit you take is directly transfered to merchant to that purpose, it doesn't go to you, so that can give credit at lesser interest rate, like car loan, home loan
 - Food Coupons, other coupons
 
-**Regenerative Finance (ReFi)**
+### Regenerative Finance (ReFi)
 
 ReFi is a beautiful idea -- a re-imagining of the financial system using the tools humanity now has at its disposal to better account for the needs of all stakeholders, current and future. It puts a price on externalities, charging those who create negative externalities (like the Once-ler) and rewarding those who create positive externalities (like the Lorax, who speaks for the trees)
 
@@ -147,13 +149,15 @@ Anchors - What is the lowest price of the product. Using Google assistant and Si
 
 Making an app that will make an online portal for any institution. Accept online payment through people and deposit to the institution bank account.
 
-**Youtube**
+### Youtube
 
 Subscribe all the youtube channel and make a channel where any people online in the youtube can see who is online. To talk to share or to discuss.
 
 Adding science videos randomly to users suggestion to increase their curiosity and also increase their IQ and brain neurons
 
-**Google**
+Audio and video quality improvement using ai in YouTube
+
+### Google
 
 Should have case sensitive google search. NCL or SMIL documents.
 
@@ -167,17 +171,17 @@ CodePen type site for java and other scripts
 
 Reading for websites and blog, where one can highlight directly in browser all the pages will be stored in there account. It will be like a notebook and everything is recorded in notebook. Can be sorted using tags for automatic distribution of pages and blogs accordingly
 
-**Personal Location Sharing Service**
+### Personal Location Sharing Service
 
 Ask to get there location notification. Where default is 1 hour. I can request anyone's location and they can allow or reject.
 
 **credit card based upi**
 
-**Online maid services**
+### Online maid services
 
 Uber like service for maids and families. 0 day leave for families. If some maid is unavailable other will take her place.
 
-**Recharge Guru**
+### Recharge Guru
 
 The single portal to recharge, no need of wallet, cashback, promo-codes.
 
@@ -193,9 +197,9 @@ Business model -
 
 When everyone is onboard with the concept to not go to first every site for offers and then recharge, we can get a cut from the recharges. And exclusive codes also.
 
-**Tech**
+## Tech
 
-**Simplify git and docker environment management**
+### Simplify git and docker environment management
 
 - It's too complex
 - If you had to teach someone (like data science guys), it's too complex for them to pull, add keys, create images, commit, push, use requirements.txt, etc.
@@ -214,7 +218,7 @@ Single Tier Architecture which automatically generates 3/4 tier architecture
   - Automatically creates api for frontend to access only that specific data and nothing else with all rate limits and all.
   - Automatically handles token / auth for frontend to access database
 
-**Study Projects**
+### Study Projects
 
 1. Create a camera that follows its subject (in case of teaching a course settings or a conference setting).
     - It should take in focus the moving person
@@ -231,7 +235,7 @@ pixxel - earth monitoring and observation using satellites
 
 Hyperspectral imaging
 
-**Others**
+### Others
 
 - Standalone chat bot for android
   - AI generated models, CS representatives

diff --git a/docs/ai/llm/llm-building.md b/docs/ai/llm/llm-building.md
@@ -23,6 +23,15 @@ RAG is an AI framework for retrieving facts from an external knowledge base to g
 
 [What is retrieval-augmented generation? | IBM Research Blog](https://research.ibm.com/blog/retrieval-augmented-generation-RAG)
 
+[What is Retrieval-Augmented Generation (RAG)? - YouTube](https://youtu.be/T-D1OfcDW1M?si=KoUb-NXATK50d3i7)
+
+[Transformers, explained: Understand the model behind GPT, BERT, and T5 - YouTube](https://youtu.be/SZorAJ4I-sA?si=-GMfzGThDO20aGkB)
+
+- Positional encodings
+- Attention
+- Self attention
+- GPT3 - 45tb of text data
+
 ## Others
 
 ![LLM Working](../../media/llm-working.jpg)

diff --git a/docs/ai/llm/readme.md b/docs/ai/llm/readme.md
@@ -87,6 +87,7 @@ Moving from information to knowledge age
 - [Harvey | Generative AI for Elite Law Firms](https://www.harvey.ai/)
 - [GitHub - mukulpatnaik/researchgpt: A LLM based research assistant that allows you to have a conversation with a research paper](https://github.com/mukulpatnaik/researchgpt)
 - [Kombai](https://kombai.com/)
+- [GitHub - RamiKrispin/lang2sql: A tutorial for setting an SQL code generator with the OpenAI API](https://github.com/RamiKrispin/lang2sql)
 
 ## Purpose-built accelerators for generative AI
 

diff --git a/docs/book-summaries/first-things-first.md b/docs/book-summaries/first-things-first.md
@@ -8,6 +8,45 @@ Important items are identified by focusing on a few key priorities and roles whi
 
 [Delegation](https://en.wikipedia.org/wiki/Delegation) is presented as an important part of time management. Successful delegation, according to Covey, focuses on results and benchmarks that are to be agreed in advance, rather than on prescribing detailed work plans.
 
+https://en.wikipedia.org/wiki/First_Things_First_(book)
+
+### How to delegate
+
 - Effective strategic delegation
 
-https://en.wikipedia.org/wiki/First_Things_First_(book)
+#### Why Delegate?
+
+- D - Develop skills and confidence in your team
+- E - Enhance efficiency by assigning the right tasks
+- L - Lighten your workload to focus on big-picture strategies
+- E - Empower team members to take initiative and grow
+- G - Generate new ideas through collaboration
+- A - Avoid burnout by sharing responsibilities
+- T - Trust your team's abilities and judgement
+- E - Elevate overall team performance and morale
+
+#### Time Value Rule
+
+1. Determine what your time is worth
+2. Delegate all tasks of a lower value
+3. Focus only on high-value activities
+
+#### 80/20 Rule
+
+- 80% of results come from 20% of efforts
+- Figure out your 20% of tasks with impact
+- Delegate the less impactful 80%
+
+#### 70% Rule
+
+If someone can do a task at least 70% as well as you, delegate it. It'll free up your time and help them grow
+
+#### The delegation wheel
+
+1. Choose wisely - decide what to delegate & pick the right person for the job
+2. Explain & train - Say why you're delegating & give clear instructions
+3. Set expectations - Clearly state their authority level & your expectations
+4. Monitor progress - Check in regularly, but don't micromanage
+5. Provide feedback - Give constructive feedback & recognize good work
+
+![delegation-wheel](../media/Screenshot%202023-12-16%20at%209.56.57.AM.jpg)
diff --git a/docs/cloud/aws/security-identity-compliance/intro.md b/docs/cloud/aws/security-identity-compliance/intro.md
@@ -132,3 +132,11 @@ SOC 2 compliance is a voluntary certification that shows an organization's commi
 SOC 2 compliance may help organizations avoid data breaches and the financial and reputational damage that can result. It can also increase an organization's brand reputation and give it a competitive advantage.
 
 SOC 2, aka **Service Organization Control Type 2**, is a cybersecurity compliance framework developed by the American Institute of Certified Public Accountants (AICPA). The primary purpose of SOC 2 is to ensure that third-party service providers store and process client data in a secure manner.
+
+## Others
+
+Open-source SAST tools such as [**Semgrep**](https://www.jit.io/blog/semgrep-to-uncover-log4j-vulnerabilities), Bandit, or  KICS can help you find vulnerabilities and compliance issues in your code.
+
+[GitHub - ossf/scorecard: OpenSSF Scorecard - Security health metrics for Open Source](https://github.com/ossf/scorecard)
+
+[Security Checks Simplified: How to Implement Best Practices with Ease - YouTube](https://youtu.be/ldAeZtTKqgE?si=nuG2CHeYqmmO1uDz)
diff --git a/docs/cloud/others/others-saas.md b/docs/cloud/others/others-saas.md
@@ -8,6 +8,15 @@ Stock Photos - https://unsplash.com
 
 https://nimbletext.com/Live
 
+## Clouds
+
+- AWS
+- Azure
+- GCP
+- Akamai - Linode - [Cloud Computing Services | VMs, Kubernetes, Storage | Akamai](https://www.linode.com/)
+- Digital Ocean
+- [India's Top Provider of Advanced Cloud GPUs](https://www.e2enetworks.com/)
+
 ## Alexa
 
 1. Skill interface

diff --git a/docs/cloud/others/readme.md b/docs/cloud/others/readme.md
@@ -17,3 +17,5 @@
 - [Ticketing / TMS](ticketing-tms)
 - [Business Rule Engine / Decision Rule Engine](business-rule-engine)
 - [Others - SAAS](others-saas)
+
+![cloud-comparision](../../media/Pasted%20image%2020231216002914.png)
diff --git a/docs/computer-science/links.md b/docs/computer-science/links.md
@@ -38,6 +38,7 @@
 34. [Different types of modern websites - Explained! - YouTube](https://www.youtube.com/watch?v=3Z_vR7WASwM)
 35. [Don’t Do E2E Testing • Dave Farley • GOTO 2023 - YouTube](https://www.youtube.com/watch?v=P_570bqxDYo)
 36. [Server Driven UI on Mobile • JJ Qi • GOTO 2020 - YouTube](https://www.youtube.com/watch?v=CtSfG8tYRdg)
+37. [From 100 Pipelines to 1 • Bhavik Gudka • GOTO 2023 - YouTube](https://www.youtube.com/watch?v=QqfIFSGl-Cg&ab_channel=GOTOConferences) - Agile and YBYO (You Build You Own)
 
 ## Podcasts
 

diff --git a/docs/databases/concepts/acid-and-base.md b/docs/databases/concepts/acid-and-base.md
@@ -3,7 +3,7 @@
 ## ACID (SQL)
 
 - A - Atomic, Everything in a transaction succeeds or the entire transaction is rolled back
-- C - Consistent - A transtion cannot leave the database in an inconsistent state.
+- C - Consistent - A transaction cannot leave the database in an inconsistent state. (MVCC - Locking)
 - I - Isolated - Transaction cannot interfere with each other
 - D - Durable - Completed Transaction persist, even when the server restarts.
 

diff --git a/docs/databases/nosql-databases/snowflake-architecture.md b/docs/databases/nosql-databases/snowflake-architecture.md
@@ -54,6 +54,25 @@ Services managed in this layer include:
 
 In Snowflake, clustering is a type of data partitioning, where unique cluster keys are specified for each table. Cluster keys are subsets of a table's columns that are used to co-locate data within the table. These keys are appropriate for comprehensive tables. The process of managing clustered data in a table is known as re-clustering.
 
+## Snowflake Caching
+
+1. Metadata Cache
+ - Object Definition
+ - Statistics
+2. Result Cache
+ - Exact results from exact queries
+ - Last 24hrs
+ - Underlying data cannot have changed
+ - Functions like current time causes expiration
+ - User can be different but role must be same
+3. Warehouse Cache
+ - Sometime called "Local", or "SSD", or "Data Cache"
+ - Contain Raw data from the table, not aggregated
+ - When warehouse is suspended, data is dropped/purged
+ - Can use partial data and go deeper for remaining
+4. Centralized Storage
+ - Long term storage, Database and tables, remote
+
 ## Links
 
 [Key Concepts & Architecture | Snowflake Documentation](https://docs.snowflake.com/en/user-guide/intro-key-concepts)

diff --git a/docs/databases/nosql-databases/snowflake.md b/docs/databases/nosql-databases/snowflake.md
@@ -102,6 +102,20 @@ Internal stages can be further categorized as follows:
 
 Used to store data files externally in Amazon S3, Google Cloud Storage, or Microsoft Azure. If your data is already stored in these cloud storage services, you can use an external stage to load data in Snowflake tables.
 
+## Zero-copy cloning
+
+Snowflake’s Zero Copy Cloning is a feature which provides a quick and easy way to create a copy of any table, schema, or an entire database without incurring any additional costs as the derived copy shares the underlying storage with the original object.
+
+1. Almost no additional storage costs for cloning data
+2. No waiting time for cloning data from one environment to another
+3. No need for administrative efforts, as cloning is as simple as a Select
+4. Since data exists only in one place, it’s easy to maintain
+5. Instantly promotes corrected/fixed data to production
+
+[Snowflake Zero Copy Cloning - A Comprehensive Guide | Encora](https://www.encora.com/insights/zero-copy-cloning-in-snowflake)
+
+[Snowflake Zero Copy Cloning - ThinkETL](https://thinketl.com/snowflake-zero-copy-cloning/)
+
 ## Snowpipe
 
 In simple terms, Snowpipe is a continuous data ingestion service provided by Snowflake that loads files within minutes as soon as they are added to a stage and submitted for ingestion. Therefore, you can load data from files in micro-batches (organizing data into small groups/matches), allowing users to access the data within minutes (very less response time), rather than manually running COPY statements on a schedule to load large batches. By loading the data into micro-batches, Snowpipe makes it easier to analyze it. Snowpipe uses a combination of filenames and file checksums to ensure that only new data is processed.  
@@ -197,6 +211,10 @@ DROP WAREHOUSE IF EXISTS sf_tuts_wh;
 
 ## Links
 
+[**Snowflake SnowPro Certification - Tutorial - YouTube**](https://www.youtube.com/playlist?list=PLba2xJ7yxHB71_GEKbQDBk0EKMq6b6S-k)
+
+[**Snowflake Tutorial - YouTube**](https://www.youtube.com/playlist?list=PLba2xJ7yxHB7SWc4Sm-Sp3uGN74ulI4pS)
+
 [The Snowflake Data Cloud - Mobilize Data, Apps, and AI](https://www.snowflake.com/en/)
 
 [What is Snowflake? 8 Minute Demo - YouTube](https://www.youtube.com/watch?v=9PBvVeCQi0w)

diff --git a/docs/databases/others/databases-others.md b/docs/databases/others/databases-others.md
@@ -311,17 +311,15 @@ https://www.confluent.io/blog/intro-to-ksqldb-sql-database-streaming
   - Memory usage is evenly balanced between the servers.
   - A minimum number of keys are relocated when the pool of servers is reduced or expanded.
 
-## Minio
+## MinIO
 
-Minio is a high performance distributed object storage server, designed for
-
-large-scale private cloud infrastructure.
+MinIO is a high performance distributed object storage server, designed for large-scale private cloud infrastructure.
 
 https://minio.io
 
-**Others**
+[GitHub - minio/minio: High Performance Object Storage for AI](https://github.com/minio/minio)
 
-- **GlusterFS**
+- Others - GlusterFS
 
 ## Ehcache
 

diff --git a/docs/devops/devops-intro/feature-toggles-flags.md b/docs/devops/devops-intro/feature-toggles-flags.md
@@ -56,3 +56,5 @@ Feature Toggles are also refered to as Feature Flags, Feature Bits, or Feature F
 https://martinfowler.com/articles/feature-toggles.html
 
 [LaunchDarkly: Feature Flags, Feature Management, and Experimentation](https://launchdarkly.com/)
+
+[Open Source LaunchDarkly Alternative](https://www.growthbook.io/compare/growthbook-vs-launchdarkly)
Original file line number	Diff line number	Diff line change
Expand Up		@@ -56,3 +56,5 @@ Feature Toggles are also refered to as Feature Flags, Feature Bits, or Feature F
		https://martinfowler.com/articles/feature-toggles.html

		[LaunchDarkly: Feature Flags, Feature Management, and Experimentation](https://launchdarkly.com/)

		[Open Source LaunchDarkly Alternative](https://www.growthbook.io/compare/growthbook-vs-launchdarkly)