- The home page now dynamically loads article content only when it becomes visible, optimizing performance and reducing initial load times.
- A new command is designed to detect various types of security advisories—such as CVEs, GHSAs, PySec, CSAF reports, and more—within articles from a specified category. The extracted advisory data is automatically transmitted to the Vulnerability-Lookup API as sightings.
- Added a way to view a collection of feeds without requiring a user identifier.
- Improved LDAP documentation.
- Various enhancements to the dark and light themes.
- Multiple improvements to the main page.
- Updated all icons and removed any superfluous ones.
- Enabled CSRF protection globally.
- Updated Python and JavaScript dependencies.
- Updated French translations.
- Enhanced light/dark theme switching for a seamless transition without flickering.
- Fixed the creation of categories via the main menu.
- Addressed various minor graphical issues related to Bootstrap 5.
- introduction of a dark theme;
- the content of the articles can now be displayed on the main page, without page reload, with the use of the Bootstrap collapsible element;
- added .well-known/security.txt page.
- various improvements to the main page;
- various improvements to the page to edit articles;
- it is now possible to edit the description of feeds;
- minimum Python version is now 3.10;
- major improvements to the layout of the main page;
- it is now possible to filter articles per category on the main page;
- improvements to the categories page with a new chart.
- secured various internal HTTP redirects.
- support of ldap-auth;
- support for reverse proxy and virtual path;
- added robots.txt and humans.txt pages.
- major improvements to the categories page;
- improved displaying of numbers with localization;
- various performance improvements.
- fixed an issue when editing the category of a feed;
- fixed issues in the JavaScript code.
- removed Twitter field from the users model;
- updated all Python and JavaScript dependencies.
- [commands] Added a function which deletes read articles retrieved since more than 60 days ago;
- [commands] added a command to delete inactive users (number of months given in parameter);
- [stats_bp] Added new blueprint for future stats and added a new bar chart in the history page.
- improved indexes of the database;
- various improvements to the Web graphical interface;
- improved code style;
- updated Python and JavaScript dependencies;
- various improvements related to the migration to Bootstrap 5.
- [controllers] fixed an issue in the management of bookmark's tags;
- various fixes.
- migrated form Flask-Script to the built-in integration of the click command line interface of Flask;
- when creating or editing a category it is now possible to assign feeds via a select multiple field.
- improved list of feeds menu. Feeds are now sorted per categories (sorted per number of unread articles). And the feed icons are displayed;
- simplify loading of the configuration file;
- speed improvements to the /history page;
- various improvements to the Web user interface and to the crawler.
- it is now possible to configure a Content Security Policy.
- a Docker configuration file is provided.
- some responsiveness work has been done. The interface is now more usable with small devices;
- the search of articles has been improved;
- improved email notification mechanism.
- various minor fixes (mainly bugs introduced on version 9.1.0 after the refactoring of the back-end).
- the Web graphical interface is now using Bootstrap 4;
- a lot of responsiveness work has been done;
- the back-end code has been refactored and cleaned;
- the configuration and deployment of Newspipe is now a lot easier.
- email address of users are no longer stored in the database. Only a nickname and a password are required to create an account;
- deployment is now done with poetry;
- removed a lot bad JavaScript code.
- feeds are now retrieved with requests. feedparser is only used for the parsing;
- improvements to the crawler.
- you can now manage your bookmarks with Newspipe;
- a bookmarklet is available in order to quickly bookmark Web pages;
- import of bookmarks from Pinboard (JSON export);
- new logo;
- refactoring and code cleaning;
- improved Heroku auto-deploy functionality.
- crawler: argument of type 'NoneType' is not iterable in html.unescape().
- a template for the articles of public feeds has been added;
- the template of the feeds is now also used for users who are not authenticated (if the feed is not private);
- tags of articles are now displayed in the UI.
- it is now possible to configure the feeds refresh interval (in minutes) for the crawler (even if the crawler is used with cron);
- various improvements to the UI of the public profile page;
- simpler format for the logs when the application is running on Heroku.
- the new name of JARR is now Newspipe;
- the user can now add its twitter link through the profile page;
- it is now possible to edit the visibility of a feed (if it should be listed in the list of the user's public profile);
- tags of articles are now retrieved in order to use k-means clustering on tags (will be faster than on the article's content);
- various improvements to the crawler (test if an article should be updated and better use of coroutines).
- improved the layout of the profile page;
- the React.js page now only lists the feeds with unread articles by default;
- improvements for the crawler.
- removed the 'refresh_rate' column from the user table;
- removed the export to HTML webzine functionality.
- improved the installation script;
- improved the deployment process with Vagrant.
- fixed a bug that occurred when deleting a user who has categories with feeds in it;
- fixed a bug that occurred when the user wants to use SQLite.
- public profile page for users (private by default);
- popular page: displays the most popular feeds recently added by the users;
- new logo.
- the profile edition page has been improved;
- the generation of the tag cloud has been improved (faster).
- fixed a bug when loading the list of stop words.
- redoing entirely the home page with react;
- implementing category;
- the classic crawler is now taking into account updated articles from feeds;
- support of HTTP proxy has been removed;
- article URL resolving has been removed (wasn't used);
- improvement of the management of users in the dashboard;
- account confirmation is now achieved with a token that expires in a specified time.
- Code re-arangement: move all code to /src/
- a filter mechanism for feeds has been added (PR #14);
- icon of feeds is now an url retrieved from the feed or the site link (PR #15).
- improvements for the bookmarklet (PR #16 and PR #18);
- performance improvements (display of the /feed page);
- enhancements for the two crawlers;
- enhancements of the UI (PR #14);
- misc changes to the models and controllers.
- it is now possible to sort the list of articles by feed title or article title;
- added base unittests.
- fixed some minor bugs;
- improved the asyncio crawler;
- automatically use the good Python executable for the asyncio crawler;
- improved controllers (enforcing better use of user_id);
- the search is now case insensitive.
- The full text search powered by Whoosh has been removed.
This release introduces a new config module and a new search functionality.
The result of a search is integrated in the main page.
The fetch call is now dependent to the selected crawling method.
The look and feel has been globally improved.
It is now possible to add a new feed from any page via a dropdown menu.
- improvements on the controllers;
- the minimum error count is now specified in the configuration file.
- new CSS;
- improved installation script;
- it is now possible to delete all duplicate articles with one HTTP delete request.
- a new page 'history' to explore your database of articles.
- updated documentation;
- minor improvements.
- changed the type of the column 'last_modified' to string.
- a new architecture with base for controllers;
- new, more complete RESTful API;
- a crawler handling errors and cache control;
- the new crawler takes advantage of the RESTful API (can be run on the client side).
- The system of email notifications for new articles has been removed. This feature was hardly used.
- articles are now identified with the id provided by the RSS/ATOM feed.
- Prevent BeautifulSoup4 from adding extra '' tags to the soup with the 'lxml' parser.
- Indexation is now used with the new crawler.
- The documentation has been updated.
- pyAggr3g470r is now working with Python 3.4. Tested on Heroku with Python 3.4.2.
- The feed crawler uses the PEP 3156 (asyncio). The action buttons are now on the left. It is easier to mark an article as read.
- major improvements of the email notifications system;
- Notifications are now sent through Postmark (for example for Heroku) or a standard SMTP server.
- activation key was too long for the database column.
Significant performance improvement for the views /favorites and /unread. The performance problem has been introduced with the release 5.6.5.
This release fixes a major bug introduced with the version 0.9.7 of SQLAlchemy (conflicts between persistent ant transcient SQLAlchemy objects).
Translations have been updated.
Gravatar extension has been removed.
Minor fix.
- It is now possible to delete articles older than a given number of weeks. This can be done via the management page;
- A new environment variable enables to activate or deactivate the self-registration.
- translations were updated;
- improved deployment instructions in the README.
- pyAggr3g470r can be deployed with the Heroku auto deploy button.
- Articles are automatically retrieved after the import of an OPML file;
- When displaying all articles (unread + read), titles of unread articles are emphasized in bold;
- A new tab is opened when clicking on the title of an article.
Performance improvements: faster database insertion of articles by
the crawler and loading of the management page.
Minor bug fixes.
pyAggr3g470r has now a RESTful JSON API which enables to manage Feed and
Article objects. The API is documented in the README file.
The main page is using a subset of this API with jQuery HTTP requests.
This release introduces a redesigned homepage which loads much faster and
is easier to read. pyAggr3g470r can now be run by Apache.
Adding a feed no longer requires a title and a site link.
This version makes it possible for a user to export all of their feeds and
articles as a JSON file for later restoration.
This release introduces some UI improvements, especially for the home page.
This release adds minor bug fixes and UI improvements.
When deployed on Heroku, the platform now uses the Postmark service to
send account confirmation emails to users. It is no longer required to
enter a first name and a last name to create an account.
pyAggr3g470r is now translated into English and French. Improvements
concerning the news retriever and the Whoosh search functionality have
been made. The user can now export all articles in JSON format.
The user of the platform now has the possibility to delete his or her
account.
This version introduces minor improvements to the Jinja templates and
bugfixes (relating to the import of OPML files with sub-categories and
relating to the Whoosh index generation).
Feeds are now retrieved in a separated process with the Gevent library.
This offers the best performance on Heroku.
pyAggr3g470r can now be deployed on Heroku or on a traditional server.
Moreover, several users can use an instance of pyAggr3g470r. A platform is
managed by the administrator, a user with specific rights.
This release introduces the import of OPML files of subscriptions.
Minor improvements have been made to the templates.
This release introduces a one step installation process with a simple
script. Minor improvements to the feedgetter module have been introduced
(the feed description is now stored in the database). Miscellaneous
improvements to the Jinja templates. Finally, more configuration options
are now offered to the user.
This version introduces some improvements for the feedgetter module
including automatic retrieval of the URL behind feedproxy.google.com,
and support for configuring the user agent and proxy. Minor improvements
were made to the MongoEngine models. Notifications are displayed with
Flask flash messages.
With this release, the user is able to update her personal information.
It is now possible to enable/disable the checking of updates for a feed.
Some performance improvements and user interface optimizations have been
done.
This is the first release of the new version of pyAggr3g470r.
The code has been rewritten with the Flask microframework and the
Bootstrap frontend framework.
HTTP proxy support has been added for the fetching of feeds. This is
useful, for example, if you are using Privoxy/Tor.
Searching of articles is now achieved with Whoosh, a fast full-text
indexing and searching library.
The code has been tested and ported to Python 3.3.1. Some minor bugs have
been fixed, with a lot of improvements concerning the Mako templates,
MongoDB database management, and management of exceptions.
This release introduces a reworked management page; it is now possible to
change the username and password via this page.
Some improvements concerning the HTML export of the database have been
made. Finally, indexed MongoDB full text searching provides a much faster
search.
pyAggr3g470r is now using the Mako template library.
Performance improvements for the MongoDB database have been made, and some
minor bugfixes. Stop words (a, of, the, an, for, …) are now ignored when
calculating top words for the generation of the tag cloud.
A new page indicates the list of inactive feeds (with no new published
articles since a given number of days).
pyAggr3g470r is now running with Python 3.2(.3). It uses CherryPy 3.2.2,
BeautifulSoup4, and feedparser3.Your old MongoDB database can be used
without any problem.
Some minor bugfixes and improvements.
An authentication screen has been added, which is useful if pyAggr3g470r
is running on an EC2 instance, for example.
This version introduces some minor improvements and bugfixes.
All features of pyAggr3g470r are now back (with MongoDB).
This version introduces minor improvements and a bugfix.
Publication dates of articles are now stored as a datetime object.
A bug in the script that converts an SQLite database to a MongoDB database
is now fixed.
A little documentation has been added.
A MongoDB database is now used instead of the SQLite database. This change
offers a significant performance improvement. The database has been tested
with more than 30,000 articles, but version 3.2 is still a test version.
A more stable version will arrive soon.
A new version of the QR Code module is used. For each article, a QR Code
is generated based on the content of the article. If the article is too
long, only the article's URL is encoded in the QR Code. For a given
string, the algorithm tries the generate as small a QR Code as possible.
Minor bugs were fixed.
This release introduces exportation of articles to the HTML format and to
the PDF format (there is still exportation to ePub).
The sharing of articles with delicious.com was replaced by pinboard.in.s
Some minor improvements. A bug with the HTML <code> tag bas been fixed.
Cleanup was done with Pylint.
The test database of pyAggr3g470r contains more than 22000 articles,
and it runs perfectly.
The feed summary page, which displays general information about a feed,
now lets you change the feed metadata (feed logo, feed name, and feed URL
if changed). Moreover, this page displays the activity of a feed and other
useful information. It is now possible to set a different POD for Diaspora
in the configuration file and to share an article with Google +1.
A control file to start or stop pyAggr3g470r has been added.
From the GUI side, a new transparent CSS tooltip has been introduced in
order to preview an article.
Finally, some minor performance improvements and bugfixes were made.
Minor improvements.
It is now possible to set a maximum number of articles to be loaded from
the database for each feed (via the management page).
This version introduces a new page that displays general information about
a feed. There are some minor improvements in the Web interface.
The version of pyAggr3g470r for Python 3 is now fully ready and has been
tested with Python 3.2.
A bug when removing a feed from the data base was fixed.
Minor improvements were made for export of articles and the size of HTML
forms.
The GUI uses more HTML 5 features like HTML5 Forms Validation
(email input, URL input), an HTML5 month+year date picker, and a
placeholder. From each article it is possible to access the
following and previous article (and a new main menu with CSS ToolTip).
Articles can now be exported to the EPUB format. Articles loaded from the
SQLite base are now stored in memory in a better data structure. With more
than 10,000 articles, pyAggr3g470r starts in 3 seconds. Finally, email
notifications are now sent with HTML message content and with an
alternative plain text version (MIMEMultipart).
This version introduces HTML5 Forms Validation and a HTML5 month+year date
picker for the history page, which can be used to search for articles.
This currently only works with Opera.
There is now a third way to export articles from the SQLite base.
There is an export method for the wiki DokuWiki (example in the commit
message).
The export of articles to HTML has been updated, with better output.
There are a number of improvements (the search function, generation of
tags cloud, display of article content, CSS, bugfixes, etc.).
There is a new Wiki.
It is now possible to browse articles by year and month with tag clouds
(see new screenshots).
In addition, URL errors are detected before downloading feeds.
There are some improvements in the user interface.
The feedgetter module was improved. More details about articles are stored
in the database when possible. An attempt is made to get the whole article
(a_feed['entries'][i].content[j].value), and in the event of failure,
the description/summary is used (a_feed['entries'][i].description).
It is now easier to install pyAggr3g470r.
There is no longer any need to set any path in the configuration file.
This release generates QR codes with URLs of articles, so you can read an
article later on your smartphone (or share with friends).
It is now possible to automatically add a feed (with the URL of the site),
delete an article, delete a feed with all its articles, and to delete all
articles from the database.
There are also some nice improvements to performance, tested with more
than 3000 articles.
Furthermore, HTML export of all the articles of the database was improved.
You can also export the articles in raw text. Finally, some minor bugs
were fixed.
Now pyAggr3g470r only works with Python 2.7.
OrderedDict objects are used in order to sort the feeds alphabetically in
a simple way.
It is now possible to remove all articles of a given feed from the SQLite
base via the management page. You can also add a feed just with the URL
of the Web page. The URL of the feed is obtained by parsing the Web page
with the module BeautifulSoup.
All articles stored in the SQLite database can now be exported as HTML or
raw text via the management page.
This version introduces a tag cloud with variable word length.
Some improvements were made to the CSS and a bug was fixed.
Introduction of a Google Buzz button.
It is now possible to mark or unmark articles as favorites.
The database of feeds is monitored with the Python gamin module,
if present. Otherwise it is done with a classic function.
You now have the option to be informed of new articles by email. To
receive these notifications, just click on "Stay tuned" for the
desired feed(s) at the main page of pyAggr3g470r in the browser.
TuxDroid tells you when there are unread articles (this module is
independent in case you don't have a TuxDroid). Moreover, the language of
articles is detected (thanks to the oice.langdet Python module). This
allows you to search for articles by language.
It is now possible to share articles with delicious, Digg, reddit,
Scoopeo, and Blogmarks.
The "Management of feeds" page presents information on the database and
statistics on articles (with a histogram). HTML tags are now skipped for
the search. Some other improvements were made.
It is now possible to search for an article, through the titles and
descriptions.
Unread articles are now shown in bold. This was implemented using a new
field in the SQLite database. New tabs for article descriptions are opened
with the _rel=noreferrer_ option in order to separate processes (useful
with Chromium). It is now possible to see only unread articles for each feed.
It is now possible to fetch feeds manually by clicking on "Fetch all feeds" and/or with cron. Better navigation between feeds and improvements to the SQLite database have been added.
- The main page display only 10 articles by feeds;
- For each feeds a page present the list of all articles. The SQLite base is smaller than before (removed hashed value);
- A lot of improvements.
- a new menu was added for faster access to feeds;
- some improvements were made to the CSS.
- Articles are now sorted by date, and it is possible to read just a description of an article;
- There are some improvements in the code and SQLite base management.
First release of pyAggr3g470r.