updated docs

deepaksood619 · Nov 5, 2024 · 937d986 · 937d986
1 parent 602e3fe
commit 937d986
Show file tree

Hide file tree

Showing 16 changed files with 52 additions and 4 deletions.
diff --git a/docs/ai/computer-vision-cv/pre-trained-models.md b/docs/ai/computer-vision-cv/pre-trained-models.md
@@ -23,6 +23,8 @@ Several pre-trained models have become standards in image classification due to
     - Residual blocks to allow gradients to flow through shortcut connections.
 - **Applications:** General image classification, object detection, and feature extraction.
 
+[Vanishing gradient problem - Wikipedia](https://en.wikipedia.org/wiki/Vanishing_gradient_problem)
+
 ### 2. Inception (GoogLeNet)
 
 - **Overview**: Developed by Google, the Inception network uses inception modules to capture multi-scale features.

diff --git a/docs/ai/data-science/datasets.md b/docs/ai/data-science/datasets.md
@@ -30,6 +30,8 @@ The Beyond the Imitation Game Benchmark (BIG-bench) is a _collaborative_ bench
 
 [GitHub - google/BIG-bench: Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models](https://github.com/google/BIG-bench)
 
+[Common Crawl - Blog - October 2024 Crawl Archive Now Available](https://www.commoncrawl.org/blog/october-2024-crawl-archive-now-available)
+
 ## YCSB Workloads
 
 YCSB includes a set of core workloads that define a basic benchmark for cloud systems.

diff --git a/docs/ai/llm/interview-questions.md b/docs/ai/llm/interview-questions.md
@@ -339,6 +339,23 @@ If you want to experiment and create many variations quickly, a high temperature
 
 [How to use OpenAI GPT-3 temperature • Gptforwork.com](https://gptforwork.com/guides/openai-gpt3-temperature)
 
+## Topics
+
+- token embeddings
+- positional embeddings
+- self-attention
+- transformers
+- intuitive understanding of Q, K, V
+- causal and multi-head attention
+- temperature, top-k, top-p
+- classification & instruction fine-tuning
+- rotary positional encoding (RoPE)
+- KV Cache
+- infini-attention (long context windows)
+- mixture of experts (MoE)
+- grouped query attention
+- basic understanding of llama-2 architecture and techniques which is actually a recap of all the previous subjects
+
 ## Links
 
 [MLStack.Cafe - Kill Your Next Machine Learning, Data Science & Python Interview. Find your next ML Job.](https://www.mlstack.cafe/blog/large-language-models-llms-interview-questions)

diff --git a/docs/ai/llm/models.md b/docs/ai/llm/models.md
@@ -3,18 +3,18 @@
 ## Intro
 
 - **Generative models** learn the joint probability distribution of input and output data.
-   	- They can generate new data instances by sampling from this distribution.
+	- They can generate new data instances by sampling from this distribution.
     - Trained on a dataset of images of cats and then used to generate new images of cats.
 - **Discriminative models** learn the conditional probability of output data given input data.
-   	- They can discriminate between different kinds of data instances.
+	- They can discriminate between different kinds of data instances.
     - Trained on a dataset of images of cats and dogs and then used to classify new images as either cats or dogs.
 
 ### Types
 
 - **Generic or raw language models** predict the next word based on the language in the training data. These language models perform information retrieval tasks.
-   	- The cat sat on ___ (answer - the)
+	- The cat sat on ___ (answer - the)
 - **Instruction-tuned language models** are trained to predict responses to the instructions given in the input. This allows them to perform sentiment analysis, or to generate text or code.
-   	- Generate a poem in the style of x
+	- Generate a poem in the style of x
 - **Dialog-tuned language models** are trained to have a dialog by predicting the next response. Think of chatbots or conversational AI.
 
 ## Models
@@ -25,6 +25,7 @@
     - [OpenAI’s new “deep-thinking” o1 model crushes coding benchmarks - YouTube](https://www.youtube.com/watch?v=6xlPJiNpCVw)
 - Vicuna
 - Bloom
+- [PartyRock](https://partyrock.aws/)
 - Claude 2.1 from antropic with a context window of 200k tokens
     - [Introducing Claude 3.5 Sonnet - Anthropic](https://www.anthropic.com/news/claude-3-5-sonnet)
     - Gemini (1.5 Pro, 1.5 Flash)
@@ -114,6 +115,7 @@ Emotional prompting example - You are Dolphin, an uncensored and unbiased Al ass
 	- [The Needle In a Haystack Test: Evaluating the Performance of LLM RAG Systems - Arize AI](https://arize.com/blog-course/the-needle-in-a-haystack-test-evaluating-the-performance-of-llm-rag-systems/)
 	- [Unlocking precision: The "Needle-in-a-Haystack" test for LLM evaluation](https://labelbox.com/guides/unlocking-precision-the-needle-in-a-haystack-test-for-llm-evaluation/)
 	- [The Needle in the Haystack Test and How Gemini Pro Solves It | Google Cloud Blog](https://cloud.google.com/blog/products/ai-machine-learning/the-needle-in-the-haystack-test-and-how-gemini-pro-solves-it)
+- [GitHub - huggingface/evaluation-guidebook: Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!](https://github.com/huggingface/evaluation-guidebook)
 
 ### Tools
 

diff --git a/docs/ai/llm/natural-language-to-sql.md b/docs/ai/llm/natural-language-to-sql.md
@@ -17,6 +17,12 @@ from langchain import OpenAI, SQLDatabase, SQLDatabaseChain
 
 [SQLDatabaseChain](https://h3manth.com/notes/SQLDatabaseChain/)
 
+## Generative BI in Telecom
+
+- [Practical use cases of Generative AI in Telecom](https://www.linkedin.com/pulse/practical-use-cases-generative-ai-telecom-n-ix-6s2gf/)
+- [pages.awscloud.com/rs/112-TZM-766/images/Altman Solon\_AWS\_Telecoms Generative AI Study.pdf](https://pages.awscloud.com/rs/112-TZM-766/images/Altman%20Solon_AWS_Telecoms%20Generative%20AI%20Study.pdf)
+- [Generative AI in Telecom: 5 Use Cases & Future Outlook](https://binmile.com/blog/generative-ai-in-telecom-industry/)
+
 ## Links
 
 - [Natural Language to SQL | LangChain, SQL Database & OpenAI LLMs - YouTube](https://www.youtube.com/watch?v=w-eTS8YlbZ4)

diff --git a/docs/cloud/others/azure/readme.md b/docs/cloud/others/azure/readme.md
@@ -8,6 +8,7 @@
 
 - Azure Data Factory (ADF) - [Azure Data Factory - Data Integration Service | Microsoft Azure](https://azure.microsoft.com/en-in/products/data-factory/)
     - Azure Data Factory is Azure's cloud ETL service for scale-out serverless data integration and data transformation. It offers a code-free UI for intuitive authoring and single-pane-of-glass monitoring and management. You can also lift and shift existing SSIS packages to Azure and run them with full compatibility in ADF. SSIS Integration Runtime offers a fully managed service, so you don't have to worry about infrastructure management.
+    - [Beginner's Guide to Azure Data Factory (Series) | Page 1 of 6 | Cathrine Wilhelmsen](https://www.cathrinewilhelmsen.net/series/beginners-guide-azure-data-factory/)
 - Azure Databricks (ADB)
 - [Azure HDInsight - Hadoop, Spark, and Kafka | Microsoft Azure](https://azure.microsoft.com/en-us/products/hdinsight)
     - Run popular open-source frameworks—including Apache Hadoop, Spark, Hive, Kafka, and more—using Azure HDInsight, a customizable, enterprise-grade service for open-source analytics. Effortlessly process massive amounts of data and get all the benefits of the broad open-source project ecosystem with the global scale of Azure. Easily migrate your big data workloads and processing to the cloud.

diff --git a/docs/cloud/others/others-saas.md b/docs/cloud/others/others-saas.md
@@ -196,3 +196,4 @@ MuleSoft is a platform that gives IT the tools to automate everything. This incl
 - [Automatic, AI-generated interview notes | Metaview](https://www.metaview.ai/)
 - [Krutrim - India's own AI](https://cloud.olakrutrim.com/)
 - Intuit - QuickBooks
+	- [Use workflows to automate your business processes](https://quickbooks.intuit.com/learn-support/en-us/help-article/feature-preferences/use-workflows-quickbooks-online-advanced-send/L6uaB8H5G_US_en_US)
diff --git a/docs/computer-science/testing/tools.md b/docs/computer-science/testing/tools.md
@@ -92,3 +92,4 @@ Robotic Process Automation (RPA) is a software program that imitates human actio
 - JUnit
 - [Getting Started with FitNesse - DZone Refcardz](https://dzone.com/refcardz/getting-started-fitnesse)
 - [Tricentis Tosca – Accelerate & Automate Continuous Testing | Tricentis](https://www.tricentis.com/products/automate-continuous-testing-tosca)
+- [#1 Browser Automation Software - BrowserStack Automate](https://www.browserstack.com/dg/playwright-automation-testing)
diff --git a/docs/knowledge/geography/new-home-place-house.md b/docs/knowledge/geography/new-home-place-house.md
@@ -363,6 +363,7 @@ A person feeding themselves a vegetarian diet would need about an acre of land a
 - [Best रियल एस्टेट investment? -- दुकान, घर, प्लॉट या कृषि भूमि? - YouTube](https://www.youtube.com/watch?v=1r67W4-rk_k)
 - [SaudaGhar - YouTube](https://www.youtube.com/@SaudaGhar)
 - [Bangalore VS Dehradun: Living on 50 Lakh+ - YouTube](https://www.youtube.com/watch?v=ADlmQRzA258&ab_channel=WintWealth)
+- [Are QIPs driving India’s realty sector?](https://finshots.in/markets/what-are-qips-and-are-they-driving-indias-realty-sector-qualified-institutional-placements/)
 
 ![Largest Real Estate Players in India](../../media/largest-real-estate-players-in-india.png)
 

diff --git a/docs/knowledge/others/climate-change.md b/docs/knowledge/others/climate-change.md
@@ -35,3 +35,5 @@ https://www.pmfias.com/carbon-nitrogen-phosphorus-sulphur-cycle
 ## Links
 
 [The Fourth Big Force: Climate Change](https://www.linkedin.com/pulse/fourth-big-force-climate-change-ray-dalio-vmt5e/)
+
+[What's happening to our water?](https://finshots.in/archive/whats-happening-to-our-water-atmospheric-water-generators-awg/)
diff --git a/docs/knowledge/others/politics/types-of-governments.md b/docs/knowledge/others/politics/types-of-governments.md
@@ -100,6 +100,10 @@ Excessive attachment to a particular sect or party, especially in religion.
 
 The principle of separation of the state from religious institutions.
 
+Secular is the state of being unrelated or neutral in regards to religion.
+
+[Secularity - Wikipedia](https://en.wikipedia.org/wiki/Secularity)
+
 ### Communism
 
 Communism (from [Latin](https://en.wikipedia.org/wiki/Latin) communis, 'common, universal') is a [philosophical](https://en.wikipedia.org/wiki/Political_philosophy), [social](https://en.wikipedia.org/wiki/Social_philosophy), [political](https://en.wikipedia.org/wiki/Political_movement), [economic](https://en.wikipedia.org/wiki/Economic_ideology) ideology and [movement](https://en.wikipedia.org/wiki/Political_movement) whose ultimate goal is the establishment of a [communist society](https://en.wikipedia.org/wiki/Communist_society), namely a [socioeconomic](https://en.wikipedia.org/wiki/Socioeconomics) order structured upon the ideas of [common ownership](https://en.wikipedia.org/wiki/Common_ownership) of the [means of production](https://en.wikipedia.org/wiki/Means_of_production) and the absence of [social classes](https://en.wikipedia.org/wiki/Social_class), [money](https://en.wikipedia.org/wiki/Money) and the [state](https://en.wikipedia.org/wiki/State_(polity)). - https://en.wikipedia.org/wiki/Communism

diff --git a/docs/knowledge/quotes-proverbs/tatoos-quotes.md b/docs/knowledge/quotes-proverbs/tatoos-quotes.md
@@ -81,3 +81,5 @@ Sleep to death
 Bellum omnium contra omnes (the war of all against all)
 
 Monkey see, monkey do
+
+_**Homo faber**_ ([Latin](https://en.wikipedia.org/wiki/Latin_language "Latin language") for '[Man](https://en.wikipedia.org/wiki/Human_being "Human being") the Maker') is the concept that human beings are able to control their fate and their environment as a result of the use of tools.
diff --git a/docs/management/project-product-business-tools-saas.md b/docs/management/project-product-business-tools-saas.md
@@ -28,6 +28,7 @@
 15. Gmail
       1. Mailman (batches incoming email and keeps brain from getting distracted by the endless trickle of new email)
       2. Zoho
+            1. Zoho Worflows
       3. https://360.yandex.ru/business
 16. Gitlab issues
 17. https://fireflies.ai - AI assistant for your meetings
@@ -49,6 +50,8 @@
 		1. [How to use Form Approvals | Turn Google Form submissions into approval workflows (English Tutorial) - YouTube](https://www.youtube.com/watch?v=eXdbUwzqI6s&t=3s&ab_channel=FormApprovals)
 		2. [Convert Google Form into Multi-Step Approval Workflow | Form Approvals add on - YouTube](https://www.youtube.com/watch?v=pnGKv3WkHTo&ab_channel=KewalKishan-AutomateBusiness)
 25. [Free Online Form Builder & Form Creator | Jotform](https://www.jotform.com)
+	1. [Jotform Workflows: Free Approval and Workflow Builder](https://www.jotform.com/products/workflows/)
+	2. [Miscellaneous Reimbursement Form](https://www.jotform.com/build/243022939651457?s=templates)
 26. [Typeform: People-Friendly Forms and Surveys](https://www.typeform.com/)
 27. [SurveyMonkey: The World’s Most Popular Free Online Survey Tool](https://www.surveymonkey.com/)
 28. [Free Online Form Builder | Tally](https://tally.so/)

diff --git a/docs/psychology/parenting.md b/docs/psychology/parenting.md
@@ -288,3 +288,4 @@ Why kicking out children after 18 years is important, let's say you are very wea
 - [Toddler Screaming](https://www.whattoexpect.com/toddler/behavior/screaming-and-screeching.aspx)
 - [The 18-Month Well-Baby Visit](https://www.whattoexpect.com/toddler/health-and-safety/18-month-well-baby-visit/)
 - [12 quick and easy toddler meal ideas: photos](https://www.babycentre.co.uk/l25020410/12-quick-and-easy-toddler-meal-ideas-photos)
+- [18 month old | BabyCentre](https://www.babycentre.co.uk/s1002004/18-month-old)
diff --git a/docs/technologies/kafka/intro.md b/docs/technologies/kafka/intro.md
@@ -196,3 +196,4 @@ https://www.confluent.io/blog/apache-kafka-2-4-latest-version-updates
 - [Kafka Tiered Storage from Uber - by Bugra Akyildiz](https://mlops.substack.com/p/kafka-tiered-storage-from-uber)
 - [Kafka 101](https://highscalability.com/untitled-2/)
 - [The Trillion Message Kafka Setup at Walmart](https://blog.bytebytego.com/p/the-trillion-message-kafka-setup)
+- [Demo: ACL Authorization · The Internals of Apache Kafka](https://jaceklaskowski.gitbooks.io/apache-kafka/content/kafka-demo-acl-authorization.html#step-8)
diff --git a/docs/technologies/kafka/migration-mirroring-replication.md b/docs/technologies/kafka/migration-mirroring-replication.md
@@ -82,6 +82,8 @@ To achieve the above transition, there are two important steps: (1) consumer off
 - [Disaster Recovery with MirrorMaker 2.0 - Confluent](https://www.confluent.io/kafka-summit-lon19/disaster-recovery-with-mirrormaker-2-0/)
 - [How to setup MirrorMaker 2.0 on Apache Kafka multi-cluster environment | by Mauro Roiter | LARUS | Medium](https://medium.com/larus-team/how-to-setup-mirrormaker-2-0-on-apache-kafka-multi-cluster-environment-87712d7997a4)
 - [How to migrate Kafka clusters without downtime | The Write Ahead Log](https://platformatory.io/blog/How-to-migrate-kafka-clusters-without-downtime/)
+- [Setting up Mirror Maker](https://www.instaclustr.com/support/documentation/kafka/kafka-cluster-operations/setting-up-mirror-maker/)
+- [Demystifying Kafka MirrorMaker 2: Use cases and architecture | Red Hat Developer](https://developers.redhat.com/articles/2023/11/13/demystifying-kafka-mirrormaker-2-use-cases-and-architecture#)
 
 ## Confluent Replicator vs MirrorMaker 2.0
Original file line number	Diff line number	Diff line change
Expand Up		@@ -35,3 +35,5 @@ https://www.pmfias.com/carbon-nitrogen-phosphorus-sulphur-cycle
		## Links

		[The Fourth Big Force: Climate Change](https://www.linkedin.com/pulse/fourth-big-force-climate-change-ray-dalio-vmt5e/)

		[What's happening to our water?](https://finshots.in/archive/whats-happening-to-our-water-atmospheric-water-generators-awg/)
Original file line number	Diff line number	Diff line change
Expand Up		@@ -81,3 +81,5 @@ Sleep to death
		Bellum omnium contra omnes (the war of all against all)

		Monkey see, monkey do

		_Homo faber_ ([Latin](https://en.wikipedia.org/wiki/Latin_language "Latin language") for '[Man](https://en.wikipedia.org/wiki/Human_being "Human being") the Maker') is the concept that human beings are able to control their fate and their environment as a result of the use of tools.