{"id":9418,"date":"2021-02-26T14:41:04","date_gmt":"2021-02-26T18:41:04","guid":{"rendered":"https:\/\/starlightcascade.ca\/blog\/?p=9418"},"modified":"2021-02-26T15:20:14","modified_gmt":"2021-02-26T19:20:14","slug":"supersid-pi-project-failure-2020feb-notes","status":"publish","type":"post","link":"https:\/\/starlightcascade.ca\/blog\/2021\/02\/supersid-pi-project-failure-2020feb-notes\/","title":{"rendered":"supersid pi project failure 2020Feb Notes"},"content":{"rendered":"

These are the notes we made during another attempt at replacing the windows netbook running supersid v1.2.2 with a raspberry pi project.
\nThis would hopefully use less power (up to $0.36\/kwh during peak time of use here at upto 40 watts all year long comes out as $82\/year), hopefully not loose a days worth of data if the data logger stopped, stop the ever decreasing Y axis power intensity over time, and we hoped to get better graphing than our own ‘R’ code was doing.
\n\"\"Sample screen capture of power density averaging negative over time<\/a><\/p>\n

In the end this failed, we think to multiple complex library dependencies failing to install.<\/p>\n

Sunday 2020 Feb 16
\n* supersidpi project<\/p>\n

From Eric Gibert
\nhttps:\/\/github.com\/ericgibert\/supersid<\/p>\n

Objectives
\nMonitoring the Sudden Ionospheric Disturbances (SID) is an easy yet exciting Home Based Radio Astronomy Project. This project is an implementation of Stanford SOLAR Center\u2019s SuperSID.<\/p>\n

The default SuperSID project software runs on Windows OS to record the pre-amplified signal received by the antenna with a \u201cSuperSID Monitor\u201d.<\/p>\n

This SuperSID project is an Open Source implementation that runs on Linux and Windows. The scripts are executable by Python 2.7 and Python 3, at your choice.<\/p>\n

This SuperSID includes a text mode which allows to turn your Raspberry Pi in a SID monitor (tested on Raspbian Wheezy & Pidora distro). TkInter in the default GUI to ensure Python 2 and 3 compatibility (but wxPython is still supported for Python 2 only).<\/p>\n

supersid.py:
\nMore options in the [configuration file (.cfg)] (docs\/ConfigHelp.md)
\nContinue recording after interruption
\nAuto adjustment of the interval period for better accuracy
\nNew extended file format with time stamp to the 1.000th of second
\nsidfile.py can be used as a utility to manipualte SID files<\/p>\n

supersid_plot.py:
\nAccepts multiple files to display up to 10 days in continue (wildcards possible)
\nCan connect to NOAA to draw the day’s events
\nCan send the graph as PDF by email<\/p>\n

pi@supersidpi:~\/supersid $ pwd
\n\/home\/pi\/supersid
\npi@supersidpi:~\/supersid $ ls -l
\ntotal 144
\ndrwxrwxrwx 2 pi pi 4096 Jan 5 09:28 backup
\ndrwxrwxrwx 2 pi pi 4096 Jan 5 09:41 Config
\n-rw-rw-rw- 1 pi pi 5287 Jan 5 09:42 confighelp.txt
\n-rw-rw-rw- 1 pi pi 12085 Jan 5 09:48 config.py
\ndrwxrwxrwx 2 pi pi 4096 Jan 5 09:29 Data
\n-rw-rw-rw- 1 pi pi 5090 Jan 5 09:49 ftp_to_stanford.py
\n-rw-rw-rw- 1 pi pi 985 Jan 5 09:47 _getch.py
\n-rw-rw-rw- 1 pi pi 4941 Jan 5 09:49 logger.py
\n-rw-rw-rw- 1 pi pi 6599 Jan 5 09:50 NOAA_flares.py
\n-rwxrwxrwx 1 pi pi 1439 Jan 5 09:25 Note.txt
\ndrwxrwxrwx 9 pi pi 4096 Jan 5 09:34 pyaudio
\n-rwxrwxrwx 1 pi pi 4703 Jan 5 09:25 ReleaseNotes.txt
\n-rw-r–r– 1 pi pi 10819 Jan 5 09:51 sampler.py
\n-rw-r–r– 1 pi pi 26754 Jan 5 09:52 sidfile.py
\n-rw-r–r– 1 pi pi 5426 Jan 5 09:52 sidtimer.py
\n-rw-rw-rw- 1 pi pi 1384 Jan 5 09:43 supersidonraspi3.txt
\n-rw-rw-rw- 1 pi pi 10512 Jan 5 09:45 supersid.py
\ndrwxrwxrwx 2 pi pi 4096 Jan 5 09:45 v1.2.2<\/p>\n

pi@supersidpi:~\/supersid $ python supersid.py
\nTraceback (most recent call last):
\n File “supersid.py”, line 21, in
\n from matplotlib.mlab import psd as mlab_psd
\nImportError: No module named matplotlib.mlab<\/p>\n

Time synchro over the Internet: ”” sudo apt-get install ntpdate ntp ”” Follow tutorial at https:\/\/victorhurdugaci.com\/raspberry-pi-sync-date-and-time
\nVirtualenv management for Python:
\nsudo apt-get install virtualenv
\nThis Raspi 3 is dedicated to SuperSid or you do not plan to mix various libraries: install at system level all the libraries.
\n sudo apt-get install python3-matplotlib
\n sudo apt-get install libasound2-dev
\n sudo pip3 install pyalsaaudio
\npip install matplotlib<\/p>\n

many minutes go by<\/p>\n

The configuration file is a simple text file formatted as a classic ‘.ini’ structure i.e. sections with squared brackets and a list of pairs ‘key=value”
\nThe supported sections are:
\nPARAMETERS
\nSTATION_x where x is a number in [1..n]
\nCapture
\nEmail
\nFTP
\nMonitor Identification
\ncontact: email or phone number of the SuperSID owner. Mandatory
\nsite_name: unique identification of the SuperSID monitor. Mandatory
\nmonitor_id: unique id to distinguish the monitors running on one site
\nlongitude: in decimal form
\nlatitude: in decimal form
\nutc_offset:
\ntime_zone:
\nLog Parameters
\naudio_sampling_rate: 48000 or 96000 (you can experiment with other value as long as your card support them)
\nlog_interval: number of second between two reading. Default is ‘5’ seconds. Reading\/sound capture last one second.
\nlog_type: filtered or raw. When filtered is indicated, bema_wing function is called to smoothen raw data before writting the file else in raw mode, captured data are written ‘as is’. Note that sidfile.py can be used as an utility to apply ‘bema_wing’ function to an existing file (raw or not) to smoothen its data.
\ndata_path: fully qualified path where files will be written. If not mentionned then ‘..\/Data\/’ is used.
\nlog_format:
\nsid_format: one file per station with first data column as timestamp and second data column as captured value
\nsupersid_format: one file for all station. No timestamp but one data column per station. Each line is log_interval seconds after the previous, first line at 0:00:00UTC.
\nsupersid_extended: one file for all station. First data column is extended timestamp HH:MM:SS.mmmmm and following data column as one per station.
\nhourly_save: yes \/ no (default). If yes then a raw file is written every hour to limit data loss.<\/p>\n

FTP to Standford server
\nVersion 1.4: FTP information are no longer part of the [PARAMETERS] section. Refer to the [FTP] section below.<\/p>\n

Extra
\nscaling_factor:
\nmode: [ignored] Server, Client, Standalone (default) . Reserved for future client\/server dev.
\nviewer: text for text mode light interface, wx for wxPython GUI or tk for TkInter GUI (default)
\nbema_wing: beta_wing parameter for sidfile.filter_buffer() calculation. Default is ‘6’.
\nnumber_of_stations: specify the number of stations to monitor. Each station is described within its own section.
\n## [STATION_x] ## Each station to monitor is enumerated from 1 till n=*number_of_stations*. For each station, one must provide: * call_sign: Station ID (various VLF station lists exist like [AAVSO’s] (http:\/\/www.aavso.org\/vlf-station-list) and [Wikipedia’s] (http:\/\/en.wikipedia.org\/wiki\/Very_low_frequency#List_of_VLF_transmissions)) * frequency: emission frequency in Hz * color: [rgbyw] to draw multiple graph together in *SuperSID_plot.py*.
\n## [Capture] ## This section can be omitted if you plan to use the ‘pyaudio’ library. If you want to use the “alsaaudio” library then you can declare: * Audio: python library to use **alsaaudio** or **pyaudio** (default), **server** reserved for client\/server future dev. * Card: [for alsaaudio only] card name for capture. Default is ‘External’. * PeriodSize: [for alsaaudio only] period size for capture. Default is ‘128’.
\n## [Email] ## The ‘supersid_plot.py’ program can send you an email with the attached plot as a PDF file. In order to use this feature, you must provide the information necessary to contact your email server as well as which email to use. * from_mail: sender’s emai * to_mail: recipient’s email * email_server: email server to use (SMPT) * email_login: [optional] if your server requires a login for identification * email_password: [optional] if your server requires a password for identification
\n## [FTP] ## Group all parameters to send data to an FTP server i.e. Standford data repository. * automatic_upload: [yes\/no] if set to ‘yes’ then trigger the FTP data upload * ftp_server: URL of the server (sid-ftp.stanford.edu) * ftp_directory: target folder on the FTP server where files should be written (on Standford’s server: \/incoming\/SuperSID\/NEW\/) * local_tmp: local temporary directpry used to write the files before their upload * call_signs: list of recorded stations to upload. Not all recorded stations might be of interrest: list only the most relevant one(s).
\nsupersid.cfg
\n[PARAMETERS]
\nviewer = text
\nsite_name = EXAMPLE
\nmonitor_id = SAMPLE1
\ncontact=ericgibert@yahoo.fr
\nlongitude = 103.8
\nlatitude = 1.367
\nutc_offset = +08:00
\ntime_zone = SGT
\naudio_sampling_rate = 48000
\nlog_interval = 5
\nlog_format=sid_format
\nlog_type = filtered
\nscaling_factor = 1.0
\nhourly_save = YES
\ndata_path = \/tmp\/Data
\nnumber_of_stations = 2
\n[STATION_1]
\ncall_sign = NWC
\ncolor = y
\nfrequency = 19800
\n[STATION_2]
\ncall_sign = VTX3
\ncolor = k
\nfrequency = 18200
\n[Capture]
\nAudio=alsaaudio
\n#Card=External
\nCard=ICH7
\nPeriodSize = 128
\n[FTP]
\nautomatic_upload = no
\nftp_server = sid-ftp.stanford.edu
\nftp_directory = \/incoming\/SuperSID\/NEW\/
\nlocal_tmp = \/tmp
\ncall_signs = NWC
\npi@supersidpi:~\/supersid $ df -h
\nFilesystem Size Used Avail Use% Mounted on
\n\/dev\/root 14G 5.8G 7.6G 44% \/
\ndevtmpfs 459M 0 459M 0% \/dev
\ntmpfs 464M 0 464M 0% \/dev\/shm
\ntmpfs 464M 6.3M 457M 2% \/run
\ntmpfs 5.0M 4.0K 5.0M 1% \/run\/lock
\ntmpfs 464M 0 464M 0% \/sys\/fs\/cgroup
\n\/dev\/mmcblk0p1 253M 53M 200M 21% \/boot
\ntmpfs 93M 0 93M 0% \/run\/user\/1000<\/p>\n

python supersid.py
\npi@supersidpi:~\/supersid $ python supersid.py
\nTraceback (most recent call last):
\n File “supersid.py”, line 21, in
\n from matplotlib.mlab import psd as mlab_psd
\n File “\/home\/pi\/.local\/lib\/python2.7\/site-packages\/matplotlib\/__init__.py”, line 133, in
\n from matplotlib.rcsetup import defaultParams, validate_backend, cycler
\n File “\/home\/pi\/.local\/lib\/python2.7\/site-packages\/matplotlib\/rcsetup.py”, line 31, in
\n from matplotlib.fontconfig_pattern import parse_fontconfig_pattern
\n File “\/home\/pi\/.local\/lib\/python2.7\/site-packages\/matplotlib\/fontconfig_pattern.py”, line 28, in
\n from backports.functools_lru_cache import lru_cache
\nImportError: No module named functools_lru_cache<\/p>\n

pi@supersidpi:~ $ pip install “backports-functools_lru_cache”
\nLooking in indexes: https:\/\/pypi.org\/simple, https:\/\/www.piwheels.org\/simple
\nCollecting backports-functools_lru_cache
\n Using cached https:\/\/files.pythonhosted.org\/packages\/da\/d1\/080d2bb13773803648281a49e3918f65b31b7beebf009887a529357fd44a\/backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl
\nInstalling collected packages: backports-functools-lru-cache
\nSuccessfully installed backports-functools-lru-cache<\/p>\n

try again 11:51
\npython supersid.py
\nfailed
\nImportError: No module named functools_lru_cache<\/p>\n

pi@supersidpi:\/ $ find . -iname functools*
\n.\/usr\/lib\/pypy\/lib-python\/2.7\/__pycache__\/functools.pypy-41.pyc
\n.\/usr\/lib\/pypy\/lib-python\/2.7\/functools.py
\n.\/usr\/lib\/python2.7\/functools.pyc
\n.\/usr\/lib\/python2.7\/functools.py
\n.\/usr\/lib\/python3\/dist-packages\/mypy\/typeshed\/stdlib\/2\/functools.pyi
\n.\/usr\/lib\/python3\/dist-packages\/mypy\/typeshed\/stdlib\/3\/functools.pyi
\n.\/usr\/lib\/python3.7\/__pycache__\/functools.cpython-37.pyc
\n.\/usr\/lib\/python3.7\/functools.py
\n.\/home\/pi\/.local\/lib\/python2.7\/site-packages\/backports\/functools_lru_cache.pyc
\n.\/home\/pi\/.local\/lib\/python2.7\/site-packages\/backports\/functools_lru_cache.py<\/p>\n

sudo cp -auvx python2.7\/* \/usr\/local\/lib\/python2.7\/
\nsudo pip install lru_cache
\npi@supersidpi:~\/supersid $ sudo pip install functools_lru_cache
\nLooking in indexes: https:\/\/pypi.org\/simple, https:\/\/www.piwheels.org\/simple
\nCollecting functools_lru_cache
\nCould not install packages due to an EnvironmentError: 404 Client Error: Not Found for url: https:\/\/pypi.org\/simple\/functools-lru-cache\/
\n sudo pip install backports_functools_lru_cache
\nLooking in indexes: https:\/\/pypi.org\/simple, https:\/\/www.piwheels.org\/simple
\nCollecting backports_functools_lru_cache
\n Downloading https:\/\/files.pythonhosted.org\/packages\/da\/d1\/080d2bb13773803648281a49e3918f65b31b7beebf009887a529357fd44a\/backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl
\nInstalling collected packages: backports-functools-lru-cache
\nSuccessfully installed backports-functools-lru-cache
\nfailed failed failed<\/p>\n

start ALL over
\nLatest image downloaded as .ZIP: 2017-09-07-raspbian-stretch.zip Download and use the easy tool to write this image etcher. Highly recommended. Boot on the new micro-SD card, follow normal process for any fresh system install.
\nExecute the classic:
\nfirmware upgrade
\napt-get update and upgrade
\nThis Raspi 3 is dedicated to SuperSid or you do not plan to mix various libraries: install at system level all the libraries.<\/p>\n

““
\n sudo apt-get install python3-matplotlib
\n sudo apt-get install libasound2-dev
\n sudo pip3 install pyalsaaudio<\/p>\n

remove microsd card and place into anker usb adapter. run balena etcher, select s:\\2018-10-09-raspbian-stretch-lite
\nflash
\nreassembled back in observatory
\ndhcp new address of
\nraspberrypi\t192.168.1.23<\/p>\n

* supersid pi – new install of raspbian stretch lite with balena etcher onto 16GB microsd
\nraspiconfig, enable vnc and ssh, reinstall in scgo and turn on
\nremote ssh to 192.168.1.23
\nchange password to house
\nsudo apt-get update
\nsudo apt-get upgrade
\ndf -h
\nFilesystem Size Used Avail Use% Mounted on
\n\/dev\/root 15G 1.3G 13G 9% \/
\ndevtmpfs 460M 0 460M 0% \/dev
\ntmpfs 464M 0 464M 0% \/dev\/shm
\ntmpfs 464M 12M 452M 3% \/run
\ntmpfs 5.0M 4.0K 5.0M 1% \/run\/lock
\ntmpfs 464M 0 464M 0% \/sys\/fs\/cgroup
\n\/dev\/mmcblk0p1 44M 23M 21M 52% \/boot
\ntmpfs 93M 0 93M 0% \/run\/user\/1000
\nreboot
\nssh 192.168.1.23<\/p>\n

sudo apt-get install libasound2-dev
\nsudo apt-get install ntpdate ntp
\nok
\nsudo pip3 install pyalsaaudio
\npip3 not installed
\nsudo apt-get install python3-matplotlib
\npip3 not installed
\nsudo apt-get install python-pip
\nstill no pip3
\ntry again
\nsudo apt-get install python3-pip
\nget supersid-master.zip
\nunzip supersid-master.zip
\ncd supersid\/Config
\nvi supersid.cfg
\ncd supersid
\npython supersid.py
\npi@supersidpi:~\/supersid\/supersid $ python supersid.py
\nTraceback (most recent call last):
\n File “supersid.py”, line 23, in
\n from matplotlib.mlab import psd as mlab_psd
\nImportError: No module named matplotlib.mlab
\n sudo apt-get remove python3-matplotlib
\n sudo apt-get install python3-matplotlib<\/p>\n

pi@supersidpi:~\/supersid\/supersid $ python supersid.py
\nTraceback (most recent call last):
\n File “supersid.py”, line 23, in
\n from matplotlib.mlab import psd as mlab_psd
\nImportError: No module named matplotlib.mlab
\nsudo pip install matplotlib
\n RuntimeError: Python version >= 3.5 required.
\n —————————————-
\nCommand “python setup.py egg_info” failed with error code 1 in \/tmp\/pip-build-oaTHq2\/matplotlib\/<\/p>\n

$ sudo rm python
\npi@supersidpi:\/usr\/bin $ sudo ln -s python python3.5
\nln: failed to create symbolic link ‘python3.5’: File exists
\npi@supersidpi:\/usr\/bin $ sudo ln -s python3.5 python
\nsudo pip install matplotlib
\nRequirement already satisfied: matplotlib in \/usr\/lib\/python3\/dist-packages
\npi@supersidpi:\/usr\/bin $ sudo pip remove matplotlib<\/p>\n

pi@supersidpi:~\/supersid\/supersid $ python supersid.py
\nReading supersid.cfg …[‘..\/Config\/supersid.cfg’]
\nSuperSID initialization<\/p>\n

———————————————————————-
\nSite: SCO Monitor: 9193
\n———————————————————————-
\n F) save Filtered buffers
\n R) save Raw buffers
\n E) save Extended raw buffers
\n———————————————————————-
\n C) list the Config file(s) parameters
\n V) Version
\n ?) display this menu
\n X) eXit (without saving)
\n———————————————————————-
\nALSA lib confmisc.c:767:(parse_card) cannot find card ‘ICH7’
\nALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_card_driver returned error: No such device
\nALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
\nALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_concat returned error: No such device
\nALSA lib confmisc.c:1246:(snd_func_refer) error evaluating name
\nALSA lib conf.c:4528:(_snd_config_evaluate) function snd_func_refer returned error: No such device
\nALSA lib conf.c:5007:(snd_config_expand) Evaluate error: No such device
\nALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM sysdefault:CARD=ICH7
\nFrom Sampler object instance:
\nCould not open capture device. Please cError alsaaudio
\nNo such device [sysdefault:CARD=ICH7]
\nTo debugg: remove the try\/except clause to get detail on what exception is triggered.
\nTraceback (most recent call last):<\/p>\n

FAILED FAILED FAILED…
\nput it all back on a shelf<\/p>\n","protected":false},"excerpt":{"rendered":"

These are the notes we made during another attempt at replacing the windows netbook running supersid v1.2.2 with a raspberry pi project. This would hopefully use less power (up to $0.36\/kwh during peak time of use here at upto 40 watts all year long comes out as $82\/year), hopefully not loose a days worth of […]<\/p>\n","protected":false},"author":494,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,15],"tags":[],"class_list":["post-9418","post","type-post","status-publish","format-standard","hentry","category-astronomy","category-tech"],"_links":{"self":[{"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/posts\/9418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/users\/494"}],"replies":[{"embeddable":true,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/comments?post=9418"}],"version-history":[{"count":7,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/posts\/9418\/revisions"}],"predecessor-version":[{"id":9426,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/posts\/9418\/revisions\/9426"}],"wp:attachment":[{"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/media?parent=9418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/categories?post=9418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/starlightcascade.ca\/blog\/wp-json\/wp\/v2\/tags?post=9418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}