updated docs

docs/about-me/achievements-activities-awards.md

@@ -30,6 +30,8 @@ I was responsible of creating a product and infrastructure around it to help sav
 
 [UnsaidTalks on LinkedIn: #unsaidtalks #mentorshipprogram #techcareers #careerguidance…](https://www.linkedin.com/posts/unsaidtalks_unsaidtalks-mentorshipprogram-techcareers-activity-7232001433175216129-Eff-?utm_source=share&utm_medium=member_desktop)
 
+[High-Level Overview of CS Domains](https://docs.google.com/spreadsheets/d/1Ojy0rC60r5FrBOpmwkwXdL_F8lKUieDpWu_SGWE-rx8/edit?usp=sharing)
+
 ### GenAI Hands-on Workshop 'From Zero to Hero: Mastering GenAI in a Flash' - SRM-IST (2 September 2024)
 
 - Zero to Hero: Master GenAI from the ground up.

docs/about-me/ideas/startups-ideas-saas.md

@@ -2,6 +2,11 @@
 
 Create best software companies with Indian labour, since labour is cheap in India like Zoho
 
+Problem with current SAAS pricing
+
+- It's per user based
+- It should be instead usage based, you use 1 GB storage and 1 cpu and 2 GB RAM, you pay for that exactly + some revenue
+
 **Developer tools - pure software play**
 
 Microproducts - [How I Sold My App For $30,000 In 4 Days | GrowthX Insider - YouTube](https://www.youtube.com/watch?v=lAUc1Gr_uDo&ab_channel=GrowthX)

docs/about-me/projects/75-bake-io-data-engineering.md

@@ -4,7 +4,7 @@
 - Creating and managing workflows/pipelines for ETL, ELT, Rollups, etc
 - Working with product and data analysts team to drive dashboard, on-chain analytics and company metrics
 
-## Links
+## Links to internal knowledge base during the project duration
 
 - [Databricks](technologies/databricks/readme.md)
 - [Delta Lake](networking/others/delta-lake.md)

docs/about-me/projects/98-others.md

@@ -0,0 +1,80 @@
+# Others
+
+## 2024-09-03 - Manav Rachna - Sabyasachi
+
+- *Problem Statement ID :* 1613 
+- *Problem Statement Title :* Automated System for Career Advancements of the Faculties of Higher Education.
+
+### Description
+
+#### Background
+
+This problem requires an innovative approach to enhance the efficiency and transparency of faculty self-appraisal in the university settings. Through a robust web-based platform, the system should address the complexities associated with traditional evaluation processes. It should capture and manages intricate details of faculty activities, encompassing research publications, event participation, seminars, projects, and lectures.
+
+The project must aim to create a user-friendly environment for faculty members, optimizing the self-appraisal experience.
+
+Employing a secure registration and login system ensures data confidentiality and personalized access. The meticulous automated tracking of research outputs (as done automatically by google scholar) and academic engagements streamlines the evaluation process, providing a consolidated record for administrators. By introducing features for logging events, seminars. projects, and lectures, the system offers a holistic view of faculty contributions beyond the classroom.
+
+This comprehensive solution should aligns with the objectives of modernizing appraisal methodologies, fostering a culture of continuous improvement, and supporting Paperless India motive.
+
+**Administrators**, on the other hand, can leverage this data to make informed decisions about faculty development and resource allocation. **University Administrators** can log in to the Admin Panel and access all the form entries submitted by the faculty members. They can view all the details in the form, sort the form entries according to Name, Employee Code or Date of Submission. They can then download the form submission details in a PDF format. In contemporary academic institutions, the process of faculty self-appraisal plays a crucial role in ensuring quality education, fostering professional development, and aligning individual contributions with institutional goals. However, traditional appraisal methods often entail cumbersome paperwork, lack of transparency, and inefficiencies that can hinder comprehensive evaluation. This real-time application seeks to address these challenges by introducing a streamlined, web-based solution that enhances the efficiency and transparency of the appraisal process. This innovative platform should be designed to meticulously capture and manage a wide range of faculty activity, including research publications (automatically as done by google scholar), event participation, seminars, projects, and lectures. By leveraging technology, the system should provide a user-friendly interface that facilitates easy logging and tracking of academic contributions. The secure registration and login system should ensure that faculty data remains confidential and accessible only to authorized personnel. Moreover, the platform should support administrators by offering a consolidated view of faculty performance. The Admin Panel should enable administrators to access, Sort, and download detailed appraisal data, thereby supporting informed decision- making regarding Faculty development and resource allocation. This digital approach should not only modernizes the appraisal process but also it should aligns with the broader objective of promoting sustainable and paperless administrative practices.
+
+### Detailed Description
+
+In the dynamic landscape of higher education, the imperative for effective systems to evaluate and enhance faculty performance has become increasingly apparent. Existing approaches to faculty appraisal often lack transparency and a data-driven foundation, hindering the ability to recognize and promote excellence. This underscores the pressing need for an innovative solution. The “Automated System for Career Advancements of the Faculties of Higher Education" project should addresses this critical gap by introducing a comprehensive and dynamic platform. This application must empower faculty members to engage in a transparent and assessment self-driven of their professional activities. By facilitating documentation and evaluation of contributions in teaching, research, and community engagement, the system must offer a transformative approach to performance appraisal within university context. The project must offer numerous benefits to both faculty members and university administrators. Faculty should be able to maintain a detailed and organized record of their professional activities, helping them track progress and identify areas for improvement. Administrators, on the other hand, should leverage this data to make informed decisions about faculty development and resource allocation.
+
+### Expected Solutions
+
+The primary objectives of the "Automated System for Career Advancements of the Faculties of Higher Education" are to alleviate the challenges inherent in traditional paper-based processes. This project must aim to streamline and modernize faculty self-appraisal by implementing a secure, user-friendly web-based platform. The key focus must be on reducing administrative burdens, minimizing time consumption through digital processes, and enhancing data accuracy. By centralizing faculty information, the system seeks to provide administrators with efficient tools for evaluation, contributing to a more transparent and accountable appraisal process. Ultimately, the project aims to optimize the overall faculty assessment experience, fostering a culture of continuous improvement in higher education institutions. REAL-TIME APPLICATION Faculty should be able to update their activities, such as research publications, event participation, and seminars, in real-time, eliminating delays associated with traditional methods. This dynamic system must ensure administrators have instant access to the latest information for timely and informed decision-making. The website's real-time capabilities enhance the overall efficiency of the faculty self-appraisal process, promoting a more agile and responsive approach to performance evaluation in the academic environment.
+
+### SOFTWARE REQUIREMENT
+
+- Web Browser: Compatible web browser (e.g., Chrome, Firefox) for accessing and interacting with the Faculty Self-Appraisal Database Management Website. -Postman: Postman for testing API endpoints and ensuring seamless communication between the web application and server.
+- Git and GitHub: Git for version control and GitHub for collaborative development, facilitating efficient code management and collaboration.
+- VSCode: Visual Studio Code (VSCode) as the integrated development environment (IDE) for code editing, debugging, and project management during the development of the web application.
+
+### HARDWARE REQUIREMENT
+
+- OS: Windows 10 or above or any other OS (e.g. Linux).
+- Processor (not minimum requirement): A modern quad-core or above for seamless and smooth development process of application.
+- RAM: At least 4 GB of available RAM to be able to run the Web App on the Browser. -GPU: Any GPU can be preferred.
+- Storage: Sufficient storage can be fulfilled by SSD or HDD. 
+
+### FUNCTIONAL REQUIREMENTS
+
+- **User Authentication:** Users must register and log in securely. Unique user profiles for faculty members and authorized administrators.
+- **Data Collection Form:** Implement a comprehensive "SELF APPRAISAL FORM" for faculty activities. Capture personal and professional details in a user-friendly interface.
+- **Manage Database:** Establish a secure database to store faculty self-appraisal data. Ensure efficient data retrieval and management for evaluation purposes.
+- **Client-Side Scripting:** Employ client-side scripting (e.g., JavaScript) for dynamic and responsive user interfaces. Enhance user experience with real-time form validation and interactive features.
+- **Server-Side Scripting:** Utilize server-side scripting (e.g.. Node.js, Python) for processing and storing data securely. Enable seamless communication between the front-end and back-end components.
+- **Event Logging:** Enable faculty to log events, seminars, projects, and lectures for a comprehensive assessment. Capture details to provide insights into faculty contributions beyond traditional metrics
+
+### NON - FUNCTIONAL REQUIREMENTS
+
+- **Performance:** The system must respond promptly to user interactions, with minimal latency during data retrieval and form submissions.
+- **Scalability:** The web application should accommodate an increasing number of users and data entries without compromising performance.
+- **Reliability:** Ensure high system availability with minimal downtime for routine maintenance, updates, or unforeseen issues.
+- **Security:** Implement robust security measures, including encryption and access controls, to protect sensitive faculty data and maintain user privacy.
+- **Usability:** The interface must be intuitive and user-friendly, requiring minimal training for faculty members and administrators to navigate and use the system efficiently.
+
+### Summary
+
+The implementation of the given problem must successfully address the longstanding challenges embedded in traditional paper-based faculty self-appraisal processes within higher education. The system must possess crucial features, such as secure user authentication, ensuring that faculty members and authorized administrators have unique and protected access to the platform. A comprehensive system should be seamlessly integrated, providing faculty members with a user-friendly interface to submit personal and professional details efficiently. The system must establishe a secure database, ensuring the confidentiality and integrity of faculty self-appraisal data. Robust client-side scripting, powered by JavaScript, it should enhance the user experience with dynamic and responsive interfaces, real-time form validation, and interactive features. Moreover, the system must include an admin panel that provides administrators with centralized access to all submitted appraisal forms. This panel must allow administrators to view, sort, and manage appraisal data efficiently. They can sort entries based on various criteria such as Name, Employee Code, or Date of Submission, streamlining the process of data retrieval and analysis. Additionally, administrators can download the submission details in PDF format, facilitating easy record-keeping and reporting. 
+
+- *Organisation :* Government of NCT of Delhi
+- *Department :* IT Department, GNCTD
+- *Category :* Software 
+- *Theme :* Smart Education
+
+### TODO
+
+- Recommendation
+- Roadmap
+
+### Features
+
+1. Recommendation system
+	1. Suggest courses and workshops
+	2. Research papers (read other research paper)
+2. Roadmap.sh
+3. Faculty self appraisal form

docs/about-me/projects/readme.md

@@ -76,6 +76,7 @@
 - [GitHub - deepaksood619/MyWebsite: My Website from scratch.](https://github.com/deepaksood619/MyWebsite) (Apr'17)
 - [GitHub - deepaksood619/Competitive-Programming: https://www.hackerrank.com/deepaksood619, http://practice.geeksforgeeks.org/user-profile.php?user=Deepak%20Sood](https://github.com/deepaksood619/Competitive-Programming) (July'17 - Present)
     - My repository where I maintain all the competitive programming questions that I have solved. It's a collection of problems from various sites like HackerRank, GeeksForGeeks, HackerEarth, CodeChef, LeetCode, and basic algorithms and data structure questions
+- [Others](about-me/projects/98-others.md)
 
 ## College Projects
 

docs/ai/data-visualization/intro.md

@@ -93,14 +93,10 @@ https://ggplot2.tidyverse.org
 
 ## References
 
-https://en.wikipedia.org/wiki/Data_visualization
-
-https://pandas.pydata.org/pandas-docs/stable/user_guide/visualization.html
-
-Time Series analysis - https://www.dataquest.io/blog/tutorial-time-series-analysis-pandas
-
-https://www.toptal.com/designers/data-visualization/data-visualization-tools
-
-https://towardsdatascience.com/8-free-tools-to-make-interactive-data-visualizations-in-2021-no-coding-required-2b2c6c564b5b
-
-https://www.freecodecamp.org/news/learn-data-visualization-in-this-free-17-hour-course
+- https://en.wikipedia.org/wiki/Data_visualization
+- https://pandas.pydata.org/pandas-docs/stable/user_guide/visualization.html
+- Time Series analysis - https://www.dataquest.io/blog/tutorial-time-series-analysis-pandas
+- https://www.toptal.com/designers/data-visualization/data-visualization-tools
+- https://towardsdatascience.com/8-free-tools-to-make-interactive-data-visualizations-in-2021-no-coding-required-2b2c6c564b5b
+- https://www.freecodecamp.org/news/learn-data-visualization-in-this-free-17-hour-course
+- [richardbrath | Visual encodings for data visualization.](https://richardbrath.wordpress.com/)

docs/ai/libraries/tools.md

@@ -65,11 +65,14 @@ https://github.com/horovod/horovod
 
 The fastest way to build custom ML tools
 
+Streamlit turns data scripts into shareable web apps in minutes. All in pure Python. No front‑end experience required.
+
 - [Streamlit • A faster way to build and share data apps](https://streamlit.io/cloud)
 - https://towardsdatascience.com/coding-ml-tools-like-you-code-ml-models-ddba3357eace
 - https://github.com/streamlit/streamlit
 - https://www.freecodecamp.org/news/build-12-data-science-apps-with-python-and-streamlit
 - [Generative AI and Streamlit: A perfect match](https://blog.streamlit.io/generative-ai-and-streamlit-a-perfect-match/)
+- [Building a dashboard in Python using Streamlit](https://blog.streamlit.io/crafting-a-dashboard-app-in-python-using-streamlit/)
 
 ## Metaflow
 

docs/ai/llm/intro.md

@@ -78,3 +78,4 @@ The architecture is a standard [transformer network](https://en.wikipedia.org/wi
 - [AWS re:Invent 2023 - Navigating the future of AI: Deploying generative models on Amazon EKS (CON312) - YouTube](https://www.youtube.com/watch?v=I22pIUSgseA)
 - [GenAI Training In Production: Software, Hardware & Network Considerations - YouTube](https://www.youtube.com/watch?v=1lhrGRqqPWU)
 - [How I Use "AI"](https://nicholas.carlini.com/writing/2024/how-i-use-ai.html)
+- [How might LLMs store facts | Chapter 7, Deep Learning - YouTube](https://www.youtube.com/watch?v=9-Jl0dxWQs8)

docs/ai/llm/prompt-examples.md

@@ -104,3 +104,9 @@ For the attached RFP
 
 1. Create questions to ask to the client for understanding the requirements more, and coming up with a proposal and sow based on the answers.
 2. Along with this create a proposal for the SOW. Write clear assumptions wherever required, give timelines, resources required and full detailed proposal with detailed tasks bifurcation. Also add the tentative duration for each phase. also provide a list of required skills, the number of resources needed, and a high-level budget estimate for the project?
+
+For this RFP, please share the questionnaire that can be sent to client for creating the final proposal, for whatever there is ambiguity
+
+For the attached RFP Create a proposal from vendor opstree to client mentioned in RFP. Create only the outline so we can add the details later.
+
+Now create a detailed plan for section 3.1 ABC

docs/ai/llm/rag-hackathon-questions.md

@@ -113,3 +113,4 @@ Customers say - https://www.amazon.in/Duracell-Slimmest-Charging-Portable-Simult
 ## Links
 
 - [AWS Gen AI Hackathon](about-me/projects/58-aws-gen-ai-hackathon.md)
+- [30+ large language model interview questions \[2024 Edition\]](https://www.analyticsvidhya.com/blog/2024/04/llm-interview-questions/)

docs/algorithms/complex-systems/game-theory.md

@@ -112,3 +112,7 @@ https://www.freecodecamp.org/news/introduction-to-evolutionary-game-theory
 ![image](../../media/Screenshot%202023-12-24%20at%202.49.25.PM.jpg)
 
 [Round-robin tournament - Wikipedia](https://en.wikipedia.org/wiki/Round-robin_tournament)
+
+## Others
+
+- A good compromise leaves everybody mad

docs/cloud/aws/compute/amazon-ecs.md

@@ -20,3 +20,5 @@ For tasks that use the EC2 launch type, Amazon ECS must determine where to place
 ## Links
 
 [Amazon ECS: Well Architected Amazon ECS lens Overview | Amazon Web Services - YouTube](https://www.youtube.com/watch?v=SjrQGvjkisg&ab_channel=AmazonWebServices)
+
+[Figma Moves from ECS to Kubernetes to Benefit from the CNCF Ecosystem and Reduce Costs - InfoQ](https://www.infoq.com/news/2024/09/figma-ecs-kubernetes-eks/)

docs/cloud/aws/compute/ec2-instance-types.md

@@ -199,6 +199,14 @@ It is possible to retrieve an instance’s IAM access key by accessing the `iam
 
 [Automate starting and stopping AWS instances - Instance Scheduler on AWS](https://docs.aws.amazon.com/solutions/latest/instance-scheduler-on-aws/solution-overview.html)
 
+### AWS AppConfig
+
+- Feature Flags
+
+AWS AppConfig feature flags and dynamic configurations help software builders quickly and securely adjust application behavior in production environments without full code deployments. AWS AppConfig speeds up software release frequency, improves application resiliency, and helps you address emergent issues more quickly. With feature flags, you can gradually release new capabilities to users and measure the impact of those changes before fully deploying the new capabilities to all users. With operational flags and dynamic configurations, you can update block lists, allow lists, throttling limits, logging verbosity, and perform other operational tuning to quickly respond to issues in production environments.
+
+[What is AWS AppConfig? - AWS AppConfig](https://docs.aws.amazon.com/appconfig/latest/userguide/what-is-appconfig.html)
+
 ## Bottlerocket
 
 Bottlerocket is a Linux-based open-source operating system that is purpose-built by Amazon Web Services for running containers on virtual machines or bare metal hosts. Most customers today run containerized applications on general-purpose operating systems that are updated package-by-package, which makes OS updates difficult to automate. Updates to Bottlerocket are applied in a single step rather than package-by-package. This single-step update process helps reduce management overhead by making OS updates easy to automate using container orchestration services such as Amazon EKS. The single-step updates also improve uptime for container applications by minimizing update failures and enabling easy update rollbacks. Additionally, Bottlerocket includes only the essential software to run containers, which improves resource usage and reduces the attack surface.