Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DMP 2024]: Indian Version of QuoDB Site #3

Open
arvind-planetread opened this issue Mar 12, 2024 · 51 comments
Open

[DMP 2024]: Indian Version of QuoDB Site #3

arvind-planetread opened this issue Mar 12, 2024 · 51 comments
Assignees
Labels

Comments

@arvind-planetread
Copy link
Contributor

arvind-planetread commented Mar 12, 2024

Ticket Contents

QuoDB is an online website that allows users to search for movie quotes and show results across multiple categories. We want to create a similar site which will work for Indian Language movies. Especially for Hindi, Tamil and Telugu. This will easily get the interest of so many millions of movie fans of Bollywood, Tollywood and Kollywood in India and the world. The starting figure itself could be easily 50 Million Plus.

Goals & Mid-Point Milestone

Goal 1:
Create a simple and clean UX and UI for the frontend of the site.
Create an admin panel for the site so that we or an authorised user from our side can add movie script information to the site.
Support Hindi Language.

Goal 2:
Support Tamil and Telugu Language support.
Allow sharing of the quotes in various web medium.
Make the website fully responsive and mobile friendly.
Add accessibility features to search by voice etc.

Goal 1 is the midpoint.

Setup/Installation

No response

Expected Outcome

The final version of the site should mimic quodb.com for Indian language movies in Hindi, Tamil and Telugu.

Acceptance Criteria

The acceptance criteria will be a fluid, functional website which has 90% plus accuracy with search.

Implementation Details

We welcome all open tech stack which can support this website which will be scaled to more languages and more content in the future.

Mockups/Wireframes

No response

Product Name

IndoMovieQuo

Organisation Name

Planet Read

Domain

⁠Education

Tech Skills Needed

Bootstrap, Database, Design, JavaScript, Mockups, Python, SQL, UI/UX/Design

Mentor(s)

@arvind-planetread

Category

Beginner Friendly, Database, Frontend, Mobile, Question

@arvind-planetread arvind-planetread changed the title Indian Version of QuoDB Site [DMP 2024]: Indian Version of QuoDB Site Mar 12, 2024
@jayesh9747
Copy link

@arvind-planetread can we use Reactjs for frontend and Nodejs for backend or we use Django for backend ?

@SanjanaSogimatt
Copy link

@arvind-planetread Can I work on this?

@arvind-planetread
Copy link
Contributor Author

@arvind-planetread can we use Reactjs for frontend and Nodejs for backend or we use Django for backend ?

Hi @jayesh9747
We have limited exposure to the tech stack relevant for the project. If you're confident in execution you can choose the tech stack, which you think is the best for this project. Please write to arvind[at]planetread.org with your resume and also give a brief explanation on how suitable you are for this project. Let me know if you have any further questions. Thank you.

@arvind-planetread
Copy link
Contributor Author

Hi @SanjanaSogimatt
As I had suggested in another reply, please send your resume and a brief explanation on how you're best suited for this project to my email arvind[at]planetread.org. We will go through the above items from a candidate before selecting one. Thank you.

@yashpatel139
Copy link

hey @arvind-planetread I'm interested in this project and want to contribute.

@R4Rohit23
Copy link

Hii @arvind-planetread I have sent you the proposal regarding the project.

@abhinavnandekar
Copy link

Hello @arvind-planetread . I think we should go with angular for frontend as we have to manage the data of 50 million plus users, and it will also help for security. And to handle such huge data we should go for hybrid structure of database.

@arvind-planetread
Copy link
Contributor Author

hi @yashpatel139 and @abhinavnandekar
Please share a proposal which has your resume, your plan for the project start to end followed by why you would be the best fit for this project. Send it to arvind[at]planetread.org. Thanks.

@SuNNy-singh0
Copy link

I think we have to use Reactjs For this Project In Create of Admin Panel is Easy and Efficient

@AbhimanyuSamagra
Copy link

Do not ask process related questions about how to apply and who to contact in the above ticket. The only questions allowed are about technical aspects of the project itself. If you want help with the process, you can refer instructions listed on Unstop and any further queries can be taken up on our Discord channel titled DMP queries.

@abcd-aakarsh
Copy link

how many candidates will be selected for this project

@alpit4
Copy link

alpit4 commented Apr 13, 2024

Hi, I am interested in this project but I want to know how to run it locally and understand it, and also where is the documentation regarding this. Provide the link respectively.

@RickDeb2004
Copy link

@arvind-planetread not able to send you mail....pls help

@Arbtrage
Copy link

Hello @arvind-planetread , I have sent you the proposal via mail.

@arvind-planetread
Copy link
Contributor Author

@abcd-aakarsh 1 person will be selected.
@alpit4 This project is started from scratch, so no documentation. You have to analyse quodb.com and come up with a proposal.

@psankhe28
Copy link

Hello @arvind-planetread, I've forwarded the proposal to you via email. Your valuable feedback would be greatly appreciated. Thank you!

@ghost
Copy link

ghost commented Apr 19, 2024

Ticket Contents

QuoDB is an online website that allows users to search for movie quotes and show results across multiple categories. We want to create a similar site which will work for Indian Language movies. Especially for Hindi, Tamil and Telugu. This will easily get the interest of so many millions of movie fans of Bollywood, Tollywood and Kollywood in India and the world. The starting figure itself could be easily 50 Million Plus.

Goals & Mid-Point Milestone

Goal 1: Create a simple and clean UX and UI for the frontend of the site. Create an admin panel for the site so that we or an authorised user from our side can add movie script information to the site. Support Hindi Language.

Goal 2: Support Tamil and Telugu Language support. Allow sharing of the quotes in various web medium. Make the website fully responsive and mobile friendly. Add accessibility features to search by voice etc.

Goal 1 is the midpoint.

Setup/Installation

No response

Expected Outcome

The final version of the site should mimic quodb.com for Indian language movies in Hindi, Tamil and Telugu.

Acceptance Criteria

The acceptance criteria will be a fluid, functional website which has 90% plus accuracy with search.

Implementation Details

We welcome all open tech stack which can support this website which will be scaled to more languages and more content in the future.

Mockups/Wireframes

No response

Product Name

IndoMovieQuo

Organisation Name

Planet Read

Domain

⁠Education

Tech Skills Needed

Bootstrap, Database, Design, JavaScript, Mockups, Python, SQL, UI/UX/Design

Mentor(s)

@arvind-planetread

Category

Beginner Friendly, Database, Frontend, Mobile, Question

I want to contribute on this

@ItsAJ1005
Copy link

@arvind-planetread Python was mentioned in the Tech Stack. I understand the backend should be done in python. Should we use Django or flask for this web application?

@arvind-planetread
Copy link
Contributor Author

@BhavaniChandra4127 Please apply in UnStop as per the application process.

@ItsAJ1005 Please consider the scale of the project and choose the one which can accomodate that scale. :)

@ItsAJ1005
Copy link

@arvind-planetread For the proposal, are wireframes and mockups sufficient? Can we commence backend development after the proposal is accepted?

@shreyp135
Copy link

shreyp135 commented Apr 20, 2024

Hello @arvind-planetread , I have emailed you the proposal for this project, including some queries. I would greatly appreciate your feedback on it. Thanks :)

@arvind-planetread
Copy link
Contributor Author

@arvind-planetread For the proposal, are wireframes and mockups sufficient? Can we commence backend development after the proposal is accepted?
Thanks for your interest.
Refer to UnStop on the proposal format and submit there.
Yes development is after proposal acceptance.

@ItsAJ1005
Copy link

@arvind-planetread I have sent the proposal via email with name 'aj harshvardhan'. Please provide suggestions regarding my proposal. Thank you.

@arvind-planetread
Copy link
Contributor Author

@ItsAJ1005 I have replied.

@kirtanchandak
Copy link

Hey Arvind,

I am Kirtan a Full Stack Developer from Pune. Previously have done two internships and also contributed to open source in Next.js projects (will mention that in proposal). I have a preety good experience of building production grade applications.

Would love to work on this project and make this a powerhouse for movie quotes and make it scalable.

Thank You :)

@AbhimanyuSamagra
Copy link

Do not ask process related questions about how to apply and who to contact in the above ticket. The only questions allowed are about technical aspects of the project itself. If you want help with the process, you can refer instructions listed on Unstop and any further queries can be taken up on our Discord channel titled DMP queries. Here's a Video Tutorial on how to submit a proposal for a project.

@chetanpawar29
Copy link

Hi @arvind-planetread , I would like to work on this project. My tech stack includes Bootstrap, Database, Design, JavaScript, Python, SQL, UI/UX/Design.

@harshilshah99
Copy link

Hello @arvind-planetread , I've sent you the proposal via email and would greatly appreciate your valuable feedback on it. Thank you!

@arvind-planetread
Copy link
Contributor Author

@Chetan-Vilas-Pawar
research if that tech stack is enough and find out what it could be lacking. then if you manage to find a better stack, email to arvind[at]planetread.org

@anurag6569201
Copy link

@arvind-planetread Hello their I am Anurag Singh and I really excited to be part of this project ...my Tech stacks are html CSS JavaScript bootstrap reactjs(recently learned) Django MySQL SQLite

@jayesnc2512
Copy link

jayesnc2512 commented Apr 27, 2024

Hello @arvind-planetread
Apart from tech stack for the frontend or the backend, the scale and the attraction of the user could be more determined with the possible ways to optimize the searching techniques regardless we use python based framework or javascript based framework.upon researching about this project, I came across two possible ways to optimize these searching of quotesfrom multiple scripts.
First being elasticsearch and another could be using normal text search and performing multi-processing. Both of these ways could work with both python based and javascript based framework. The encoding plays a crucial role in text language setting. I'm trying using conerting hindi srt files into a single types of encoding so that the encoding style is uniform which does cause any issues during the search.
Could you please tell me if I'm in the right direction or not so that I could continue to build a proposal for the solution.
Thank you

@meghnadutta02
Copy link

Hello @arvind-planetread ,I have an idea for this project. Instead of merely displaying the movie quote along with the movie title, what if we could also present the specific scene where the dialogue is delivered? This way, users could not only see the quote in context but also have the option to share this snippet. This feature could potentially enhance user engagement and experience.

@jayesnc2512
Copy link

Hello @arvind-planetread ,I have an idea for this project. Instead of merely displaying the movie quote along with the movie title, what if we could also present the specific scene where the dialogue is delivered? This way, users could not only see the quote in context but also have the option to share this snippet. This feature could potentially enhance user engagement and experience.

Hey @meghnadutta02, I think it's really a wonderful idea. There might be some issues aligning with this problem statements. This requires a huge database size to store a full movie. Even if we consider storing only references of the movie and provide some link to the user, there are very diversified platforms we are looking at, some of them being free others being paid. I think we can implement this idea by giving the references for the movie to the user. I don't think it is feasible to present the scene directly where the dialogue delivered.
Perhaps might be a thing we could work and research upon. @arvind-planetread Your take on this?

@laveenahub
Copy link

Hello! I would like to work on UI design

@meghnadutta02
Copy link

@arvind-planetread, I have sent you the proposal via email. I would greatly appreciate it if you could take the time to review it and share your valuable feedback. Thank you.

@Nivedita-MN18
Copy link

I recently came across the IndoMovieQuo project and was truly inspired by its mission to create a platform for Indian language movie quotes, catering to the diverse audience of Bollywood, Tollywood, and Kollywood fans.

As someone passionate about both technology and cinema, I am excited about the opportunity to contribute to this project and help bring it to fruition. The goals outlined, particularly in creating a simple and intuitive user experience, supporting multiple languages, and incorporating accessibility features, resonate strongly with me.

My background in [mention relevant skills or experiences, e.g., frontend development, UI/UX design, database management] makes me confident in my ability to contribute meaningfully to achieving the project's goals. Additionally, I am eager to learn and collaborate with the team to deliver a high-quality product that meets the needs of its users.

Could you please provide guidance on how I can get involved in the project? Whether it's contributing to the frontend development, assisting with UI/UX design, or any other aspect where my skills could be of value, I am eager to lend a hand.

Thank you for considering my interest in joining the IndoMovieQuo project. I am looking forward to the opportunity to work together and make a positive impact in the realm of Indian cinema.

@meghnadutta02
Copy link

Since I haven't received a response yet, I wanted to kindly remind you about the email I (Meghna Dutta) sent regarding the proposal. Your input is important to me, so if you could take a moment to review it and share your thoughts, I would greatly appreciate it.

@arvind-planetread
Copy link
Contributor Author

@anurag6569201 please create a proposal as mentioned over at UnStop and apply there.
@jayesnc2512 you are in the right direction, Please create a proposal and submit at UnStop.
@laveenahub You can if want to contribute to only UI but you will not come under C4GT programme and its stipend.
@Nivedita-MN18 please write to [email protected]
@meghnadutta02 I have emailed you back. sorry for the delay.

Thanks to you all. :)

@anurag6569201
Copy link

Hello @arvind-planetread ,I have an idea for this project. Instead of merely displaying the movie quote along with the movie title, what if we could also present the specific scene where the dialogue is delivered? This way, users could not only see the quote in context but also have the option to share this snippet. This feature could potentially enhance user engagement and experience.

Hello @arvind-planetread ,I have an idea for this project. Instead of merely displaying the movie quote along with the movie title, what if we could also present the specific scene where the dialogue is delivered? This way, users could not only see the quote in context but also have the option to share this snippet. This feature could potentially enhance user engagement and experience.

That will be challenging because in quodb they are showing the timestamp only but not the image..... for image or a scene we will required to render that movie and at that time stamp snapshot of the movie.....and doing all this stuff will increase loading time period apart of it.... good thinking we can try for better solution or any better approach for this.

@meghnadutta02
Copy link

@anurag6569201 There's already a website called playphrase.me that does this for hollywood movies. You can check that out. It's actually pretty fast .

@anurag6569201
Copy link

@anurag6569201 There's already a website called playphrase.me that does this for hollywood movies. You can check that out. It's actually pretty fast .

yup I just saw that and its really fast according to my logic they have clipped the movie scenes and just using subtitle reading so that searched query starts matching with the all clips subtitle and put those video in front of us ...that can make that working but required lot of work ....yes we can automate that like putting full movie and break it into clips and then auto post to the database....what you think what possible solution can be their?

@Mrunalkhanke
Copy link

Respected Mentor @arvind-planetread
I am reaching out to express my interest in contributing to the Indian Version of QuODB site project listed on GitHub. After reviewing the project details and its tech stack, I am excited about the opportunity to collaborate and contribute to its development.
With over 3 years of professional experience in HTML, CSS, JavaScript, and PHP and as a UI/UX designer , I have honed my skills through the creation of numerous projects, totaling six in number. Additionally, my freelancing experience has allowed me to work on real-time full-stack projects, further solidifying my proficiency in these technologies. have also actively participated in various hackathons, including Devshouse 2024, She Hacks 2024, and Smart India Hackathon, where I had the opportunity to apply my skills to solve real-world challenges under tight deadlines.I would be grateful for the opportunity to discuss further details and explore how I can contribute to the project in alignment with your vision. Please let me know if you would be available for a discussion at your earliest convenience.
Thank you
[email protected]

@Vedanshi4
Copy link

I would like to participate in this project.
Thanks.

@arvind-planetread
Copy link
Contributor Author

@Vedanshi4 Prepare a proposal and submit at UnStop. If you have any queries on the project, write to [email protected].
Thank you.

@Utsavladia
Copy link

"Hi there! I've applied for this project through Unstop and completed all the necessary steps.
I'm eager to contribute to this project and have a good understanding of the requirements and ready to give complete effort to make it success.
Please consider assigning this task to me. Looking forward to collaborating with you! 😊"

@HimanshuKumarSah
Copy link

Hey @arvind-planetread
I have worked with HTML, CSS for creating multiple websites for hackathons and one my recent projects was to make a similar website to MakeMyTrip, but assisted by machine learning and prompt engineering. I am also a graphic designer as well have done some UI/UX projects as well. I can help in planning the layout of the website, creating mockups in figma, making it look elegant and pleasing to the customers.

@arvind-planetread
Copy link
Contributor Author

@Utsavladia
@HimanshuKumarSah
I will review your submitted proposals and get back to you if required. Thank you both.

@babitarit
Copy link

@arvind-planetread sir i had sent u email kindly check it

@Taruna-M
Copy link

Taruna-M commented May 8, 2024

Hello sir @arvind-planetread I have recently submitted my proposal for this project in Unstop via the Code For Gov Tech program. Would really like to contribute and learn from this project. I have been working recently with web technology and I would like to work on my skills under a mentor. I have mentioned my ideas for this project and how to approach it in my proposal. Anyway I can get in touch?

@PlanetRead PlanetRead locked and limited conversation to collaborators May 10, 2024
@arvind-planetread
Copy link
Contributor Author

@babitarit @Taruna-M I will review your proposal and will get back to you if I select that proposal. 👍

@PlanetRead PlanetRead unlocked this conversation Jul 4, 2024
@Arbtrage
Copy link

Arbtrage commented Jul 4, 2024

Weekly Goals

Week 1

  • Researched potential integration strategies for Elasticsearch with the FastAPI backend to optimize search functionalities.
  • Explored various embedding models suitable for converting movie quotes into searchable embeddings, including those offered by OpenAI, Mistral, and Sentence Transformers.
  • Conducted an in-depth review of Elasticsearch documentation to understand best practices for building a semantic search engine capable of handling complex queries.

Week 2

  • Developed the initial API routes in FastAPI, incorporating basic Docker configurations for container management.
  • Established database connections for Elasticsearch and configured Docker containers to ensure seamless service interaction.
  • Configured Kibana for real-time monitoring of Elasticsearch indices to facilitate easy debugging and data visualization.

Week 3

  • Began integrating Elasticsearch for robust management of movie quotes data, ensuring a scalable setup.
  • Designed basic data models in Elasticsearch to efficiently store and retrieve movie quotes along with related metadata.
  • Implemented essential CRUD (Create, Read, Update, Delete) operations through FastAPI, enhancing the backend's capability to interact dynamically with Elasticsearch.

Week 4

  • Integrated Celery with Redis and Flower to manage long-running jobs effectively, such as bulk data uploading from CSV files.
  • Continued enhancement of the API to support dynamic database interactions and ensure data consistency.
  • Focused on improving error handling and data validation within the API to prevent data corruption and enhance user trust.
  • Encountered and began troubleshooting a serialization issue in the worker threads, affecting the handling of movie quote data.

Week 5

  • Directed efforts towards resolving the serialization error in worker threads to ensure smooth data processing.
  • Initiated the setup of the Next.js application, focusing on routing and basic framework configuration using Create Next App.
  • Developing foundational UI components, including a search bar, quote display cards, and intuitive navigation menus to enhance user interaction.
  • Researching further into Elasticsearch capabilities to implement support for multilingual search, accommodating diverse user bases.

Week 6

  • Implemented multilingual search functionality using Elasticsearch.
  • Integrated CockroachDB to store metadata related to the quotes.
  • Developed a mechanism to retrieve quotes along with search results from the Elasticsearch database.

Week 7

  • Initiated the deployment of frontend code on Vercel.
  • Created configuration files for the monorepo setup.
  • Continued work on implementing the Elasticsearch search mechanism.

Week 8

  • Conducted testing of the search functionality.
  • Created Docker files for containerizing the server build.

Week 9

  • Integrated server APIs with the frontend.
  • Initiated server deployment on AWS EC2.
  • Configured Nginx for public server access.

Week 10

  • Tested and optimized the search functionality to improve single result display.
  • Implemented bulk upload options using CSV and SRT files.

Week 11

  • Conducted thorough testing of the entire application.
  • Merged the monorepo into a single repository and deployed both the frontend and backend on a single EC2 instance.

Week 12

  • Monitored deployment for bugs and addressed crashes.
  • Enhanced site responsiveness.
  • Worked on technical and user documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests