Avatar of Steve Barnes

Steve Barnes

Lead Software Tools Engineer at Leonardo UK
Lead Software Tools Engineer at Leonardo UK·

The company needed to move from hosting all of our repositories, tickets & releases from a GForge instance hosted by our former parent company. The decision was made to move to GitHub Enterprise but the developers were not told until there was 1 month left to go. So needed something that could pull all of our information out and push it to the new hosts and it needed to be done ASAP.

READ MORE
7 upvotes·251.1K views
Lead Software Tools Engineer at Leonardo UK·

I would specifically recommend basing your application on Pandas which will handle the vast majority of the work for you. You will be amazed at what you will be able to get done with only a few lines of code.

Pandas can load the data from either Excel xslx files or csv files (and a lot of other places)

If you structure your code well you can have a cross platform command line program, a GUI desktop program, a Jupyter Notebook and a web service all with the vast majority of the code in common.

A jupyter notebook is a great place to start developing your code and may be all that you need.

Some plug-ins & resources that can help: - pandas-summary (for a rapid overview of the data): https://github.com/mouradmourafiq/pandas-summary - pandasgui (for exploring what you would like to do): https://github.com/adamerose/pandasgui - Pandas-Bokeh (plotting): https://github.com/PatrikHlobil/Pandas-Bokeh - plot.ly (plotting): https://plotly.com/python/pandas-backend/ - wxPython (for a desktop GUI): https://wxpython.org/

READ MORE
6 upvotes·2 comments·8.8K views
tellronneely
tellronneely
·
October 30th 2020 at 4:17PM

yes. plotly xor bokeh. either would work.

·
Reply
hala2030
hala2030
·
November 1st 2020 at 6:19AM

it did not cross my mind "big data" things ..Thanks

·
Reply
Lead Software Tools Engineer at Leonardo UK·

Since I believe Android Studio now supports Python plugins &/or invoking Python scripts I personally would use MoviePy (https://zulko.github.io/moviepy/) as a wrapper around FFMPEG &

ImageMagick (https://www.imagemagick.org/script/index.php) - this combination will allow you to have a script that takes in an image or video, resizes it to a specified size, adds the text, (either scrolling it in or fading in/out or even with some special effects), then saves the output video. There are example scripts on the MoviePy site on how to do these. While you could do it yourself with FFMPEG & ImageMagick plus command line parameters I personally find using MoviePy much more clear & maintainable.

If you want the end user to be able to supply the image/video then you will need to set up a server somewhere that can take in the POSTed image and return the processed results.

READ MORE
4 upvotes·11.8K views
Lead Software Tools Engineer at Leonardo UK·

There are already a couple of cookiecutter templates for streamlit but if you are doing multiple similar sites rolling your own template is probably a really good idea. Jupyter plus streamlit-jupyter can be a way of speeding up development and testing allowing you to preview many of the streamlit components. If your sites grow more sophisticated or require user validation you may wish to consider using django. Note that it is important to use the python built-in functools caching decorators on the methods in your streamlit py file.

READ MORE
4 upvotes·324 views
Lead Software Tools Engineer at Leonardo UK·
Recommends
on
PandaPanda

I would seriously recommend taking a look at Pandas https://pandas.pydata.org/ (which is a Python library) as it can do a huge amount of the work for you. You could provide both canned pandas filters/transformations and the ability for the user to create their own either via an option picking mechanism or by creating blocks of pandas code.

READ MORE
3 upvotes·1.9K views
Lead Software Tools Engineer at Leonardo UK·

I would recommend learning to use both python & power shell (plus Linux/WSL) by using them to do aspects of your current work better/faster/easier. You will definitely benefit from reading https://docs.microsoft.com/en-us/windows/python/scripting.

I would suggest taking a look at https://automatetheboringstuff.com/ - with a little thought I am sure that there are aspects of your current role that you can simplify or enhance by following the suggestions & doing so will give you valuable experience and may result in offers of more interesting roles growing from your current one.

READ MORE
2 upvotes·91.1K views
Lead Software Tools Engineer at Leonardo UK·
Shared insights
on
xlwingsxlwings

Custom python functions within Excel. (MS Haven't added Python to Excel YET). xlwings

READ MORE
1 upvote·4.6K views