|
|
|||||
|
ENGINEERING NOTE BOOK CHAPTER 24 (Here for earlier chapters) This is the current Problem Of the Day (POD) It's a Blog - Read from the bottom up... 132 ET Detector (2007-03-05 to 2007-03-17) I now have a running ET Detector running. This is how it works. The Spectrum Analyzer (below) produces a waterfall display (next picture).
The waterfall converts each display from the Spec Ana into a waterfall where time zero is at the top and audio frequency runs from left to right.
|
|
SETI Alarm |
1. Keep a running sum of each bins data:
2. When the last line of the waterfall has been drawn then calculated the average value of each bin.
3. Examine each column average compared to the surrounding averages.
4. Test this value against the column average for the bin under test and a threshold percentage
|
The segment size in effect breaks up the audio response curve into small segments that can be considered flat. If I simply tested the bin under investigation against all the other bins then the lower values on either side of the curve would have disproportionate importance in the calculation. I also added a 30 position graphic equalizer (hardware) in the audio line to flatten out the response as much as possible.
Setting the best segment size is done by trial and error where a spectrum without a signal will produce an acceptably small number of false positives with as low a threshold as possible.
I have found that the best segment size is between 10 and 20 bins and on my system a threshold of 20 to 40% produces a small number of false positives and still detects signals that I can't see by simply glancing at the waterfall.
When the alarm goes of I stop all frequency scanning, lock the antenna on the current DEC and Ra, and start recording the WAVs and JPGs.
The number of false positives is *extremely* important if you don't want if you don't want the ET Alarm to roll you out of bed too many times each night.
131 Image Analysis (2007-02-17 to 2007-03-05)
With the end in sight of the bird hunt and after many thousand of JPG images viewed I have come to a decision that I have been putting off for a very long time. I must face the problem of automatic image classification. Its just to mind numbing to spend three or four hours every morning reviewing the nights collection of JPGs looking for signals.
The principal problem is that the signals that I am looking for are very near the noise level of SETI Net. They are relatively easy to see with the eye but, as you know, the human eye has been trained over eons of time to recognize patterns in noise as a survival skill (is that a leopard hiding under that bush or simple leaves rustling in the breeze? Get it wrong and your lunch) but software is actually very poor at this task.
I have asked several in the community for suggestions on how to proceed and have gotten very few responses from people who should have a solution at hand if there is one.
One suggestion came from the SETI@Home people to look at there open source algorithms for this type of search. I have yet to do this but I will.
Another suggestion came from Earl F. Glynn who has a very good web site (www.efg2.com) that deals in color imaging and problems associated with this discipline. Earl suggested the following:
I’m assuming you’re looking for the vertical “lines” in the images?
My PixelProfile project needs to be updated, but I took a quick look at your data with it:
http://www.efg2.com/Lab/ImageProcessing/PixelProfile.htm
See the attached Word document. You can see the pixel profile right over one of the lines of interest shows different statistics than a “noise” line. My guess is that you could compute statistics vertical line by vertical line – I’d look for a difference in either the mean or standard deviation, perhaps both, trying to find a statistical discriminator. R would be a good tool for statistical analysis, but it’s a bit weak for image processing. There are some packages that would read images into R, but I haven’t used them much.
A “hough transform” can be used to find lines in an image, but I haven’t used them much so I’m not sure how effective that approach might be.
I hope the statistical pixel profile approach might work for you.
This seems like good advice and I have started the looking at his PixelProfile program as a way to start. What a 'hough transform' is and how it works is a mystery to me at this time.
130. Bird List ( 2007-02-12 to 2007-02-22)
This is the completed bird list. It was compiled by scanning the width of my Band Pass Filter (1375 to 1450 mHz) in 15 kHz increments. Each segment was recorded as both a WAV file and a set of JPGs. The JPGs were then reviewed by my high speed line detection hardware (my eyes and brain) for signs of lines. When a line was found it was rescanned by moving the receiver to that frequency and looking again for the signal.
When the signal was found again it is considered a Bird or image or some other local oscillator and its frequency entered in the list. This list will be used to make up a 'No Fly Zone' for the receiver when scanning.
When the signal was NOT found the pointing angles were retrieved from the JPG (using the SETI Net File Manager) and the nearest star selected. This task has no science involved because I only use named stars listed in the Archive section and the star maybe a long way from the indicated antenna pointing location. The files (the JPG and the JPG thumbnail) are then moved to that star entry in the archive for further analysis.
BIRD LIST MOVED TO THE SYSTEM PAGE
129. Sighting Camera ( 2007-02-03 to 2007-02-03)
I decided to install a camera on the horn so that I could see Sirius and verify my pointing angle. I bought a Q-See QSBVC bullet color outdoor camera at Fry's and installed in on the horn. I then re-installed a video switch that was once part of a surveillance suite of cameras and alarms and hooked both cameras to it. It now switches between them once every couple of seconds.
I then looked up the suns position (I use a Navy site) and moved the antenna to that point. I could see that the horn shadow covered the center of the dish so I knew that the dish was pointing correctly. I then switched to the horn view and could see the sun directly. I marked the image on my small TV screen with a bulls eye so I know where Sirius should be when it comes up tonight.
I am also feeding both cameras to this web site, one at a time, so if you see the antenna and next time nothing you know which one is the horn view. We will see how well it works tonight.
128. New LNA BPF Power Supply ( 2007-01-30 to 2007-01-30)
I noticed that the Band Pass Filter (BPF) wasn't pulling in reliably and after looking at the schematic I could see why. I was supplying +15 Volts to the focal point rather than the +20 V I had planned on. I put a new +24 V power supply in the control box and it works much better now.
To test the filter I tuned the receiver to the GPS satellites (1575 435 000 Hz) and pointed the antenna to Az 120 El 40 degrees and then switched the filter out half way through the waterfall. As you can see the carriers are reduced to a very low level by the BPF.
127. Line Amp Failure ( 2007-01-27 to 2007-01-28 )
One of the amplifiers in the RF string failed and I didn't catch it until today. Its a simple fix but all the data I had collected for the last two weeks has been with a dead amplifier (no wonder I haven't seen any lines lately). All the WOW data is useless and I will have to start over.
So that this doesn't happen again I am going to use the carrier I detected as a test signal. It produces a nice line (faint but viewable) when the receiver is tuned to:
1406 461 100 Hz AM
This is set as memory channel 2 on the R7000
126. SETI Net Signs of Life ( 2007-01-12 to 2007-01-25 )
After disasters attempts at moving the site through three different web hosting companies It seems to be alright now.
125. SETI Net Dead ( 2007-01-10 to 2007-01-12 )
124. System Status Report ( 2007-01-05 to 2007-01-05 )
I wanted a way that visitors to the SETI Net web site could tell at a glance what was going on. I wanted a status box on the splash page that gave an up to the minute 'box score'. I have it running now and you may have noticed it when you visited last. This is how its done.
You would think that getting dynamic data on a web page would be simple. You may think that but you would be wrong. Its fiendishly complex. All my pages except the first are static. Nothing changes on them unless I fire up Front Page and make the change. When you want dynamic web pages you have a universe of techniques to choose from and they all have one thing in common - they are complex to learn and to implement. I wanted something simple for a single box on one page not a whole new architecture.
The status box is created this way:
123. Bird List ( 2006-12-30 to Present )
Now that I'm (mostly) past the design/debug stage and into actually collecting data and searching for ET I realize that I will have no problems finding carriers. Every time I turn the system on and collect an hours worth of data 75% of the time I see lines . Right now I'm searching Betelgeuse and the third JPG turned up a nice carrier form somewhere. When I go back and track it down it will probably be a local signal so to keep from searching, and finding, the same bird over and over I have to build an exclusion list. This is as good a place as any to start (Click to view).
Notice that by simply referencing the SML file I get *all* the information that there is for each bird. That's the power of SML.
122. Cable Modem Interference ( 2006-12-29 to Present )
I finally found the source of the carrier at 1420 000 000 Hz. Its been plaguing me for a while and of course its inside my shack all along. This fine, stable, signal generator is my cable modem. I'm connected to Time Warner (Road Runner) and using a Motorola SB4200 Surf Board modem.
Now - what to do about it?
121. Getting Ready for Field Day ( 2006-12-18 to Present )
( I have put this problem on hold for a while )
The software and hardware for SETI Net is now so complex that its easy to loose track of it and if that happens it cannot be depended on if an actual contact situation arises. I need to take stock and see how it would perform in an actual operational mode. Something like this takes place in amateur radio - its called Field Day. Once a year hams that want to participate in Field Day haul there equipment to some field and make contacts with one another and make a contest out of it. The real purpose is to make sure that the equipment will work in an emergency and that the operator can manage the equipment and has not forgotten that all important 'can opener' - you know the one tool that you left on the counter when you pulled out and are now sunk without.
This is how I plan to proceed:
So this is the start.
Hardware Setup - Computer setup and connection to antenna
Antenna Setup - The main antenna is set to a known operating point
Station Software Setup - The File Manager is setup and test recordings completed
Normal Operation - Data is collected and the receiver is stepped in frequency or stepping is stopped for ad hoc investigation
Ad Hoc with Spec Ana - During data collection team scans RF for interesting features
Ad Hoc with JPGs - During data collection team scans JPGs for interesting features
120. Storage Requirements ( 2006-12-15 to 2006-12-17 )
|
It seems like there should be more of a difference in the size of the WAV files. I'll look into it.
Answer: My software saves the WAV when it runs out of buffer space which is at 50 Meg regardless of how its collected. WAV files are all sampled at 44,100 16 bit mono so natch they would all be the same size - duh.
119. Antenna Movement ( 2006-12-12 to 2006-12-13 )
The Paraclipse antenna was having a hard time moving through 180 degrees Az. It would start fast and slew toward the goal but then stop short. I found that I had to adjust the velocity constant (AzVelocity = 2000) a lot lower than it had been. This makes the antenna move slower in Az but that's just fine.
The current constants are:
| NumAntModules = 3; // The current number
of Kerr modules on the antenna ElPulsePerDeg = 1531; // Recalculated 2005-04-30. 1. find home. 2.using Kerr move to max, note pulses 3. ElMaxChange / pulses = pulse/deg ElOffsetFromZero = 6; // Measured minimum angle (0 degree wedge) ElPosError = 30000; //12000 ElMaxChange = 35; // Maximim movement from minimum angle from rotor reference was 38 until 2006-07-29 ElPWM = 255; // was 220 Sent to rotor for homing ElVelocity = 100000; // was 101000 ElAcceleration = 100; // was 230 ElKp = 47; // was 30 Default in NMC Test is:100 ElKd = 4100; // was 1000 Default in NMC Test is:1000 ElKi = 50; // was 50 Default in NMC Test is:0 ElIl = 0; ElEl = 14000; ElOl = 255; ElCl = 0; ElSr = 1; ElDc = 0; ElSm = 1; AzPulsePerDeg = 87; // was 91 one 2006-11-11 // Recalibrated setup 2006-03-12 (255 to 90 = 165 deg @ 15,000 pulse for full turn ) AzKp = 59; // Kd Position gain 50 AzKd = 3000; // Kd derivative gain 3000 AzKi = 0; // Ki Integral gain 100 AzIl = 0; AzEl = 14000; // 12000 AzOl = 255; AzCl = 0; AzSr = 10; AzDc = 40; // was 45 AzSm = 1; AzVelocity = 20000; // was 100000 on 2006-12-13, 12000 checked on 2006-06-14 AzAcceleration = 100; //was 90 checked on 2006-06-14 1000 AzPWM = 200; // checked on 2006-06-16 200 AzMaxChange = 165; // Stop to stop checked on 2005-04-26 AzDeadZone = 180 - AzMaxChange; |
118. Remote Client Sky Map Problem ( 2006-12-14 to 2006-12-12 )
While working on the help files for the Remote Client I realized that the Sky Map was being shown as if the antenna were local to the user. Of course it's not - It near San Diego. To make the fix the new client checks its own time zone bias (number of minutes later than UTC) and subtracts that from 480 which is San Diego's bias. The difference is then subtracted from the local UTC and used as the time bases for the Sky Map. It seems to work right now.
117. Control Panel Changes ( 2006-12-12 to 2006-12-14 )
The SETI Net Control Panel integrates all the other applications in SETI Net. It consists of a user interface and links to:
Its main job is to perform the search. I determines the start frequency and Ra/DEC and then moves the antenna and receiver to that channel. It then periodically updates the File Manager with pointing angels and frequency etc. It also calculates the receiver chirp and applies it to the receiver.
The current task is to add update capabilities to the File Manager Band Pass Filter settings and the Antenna Lock indicator.
This module is nearing completion and allows more time to be spent observing rather than creating new software.
116. Client Help ( 2006-12-12 to 2006-12-12 )
I am finally getting around to writing a decent Remote Client help. This is available on line at this location now.
115. Address Space( 2006-12-06 to 2006-12-12 )
I made a calculation on the number of ‘channels’ I had to examine on my station. Here are the numbers:
Since you are all computer literate so you understand the concept of address space.
If your computer has a gig of main memory and each address of that gig is a byte (8 bits) wide then you have an address space of 1,000,000,000 X 8 bits or 8 Gigabits. SETI Net has its own address space:

So the address space of SETI Net is:
(BPF/ABW) * (RA/HPBW) * (DEC/HPBW) =
(100 E6 / 20 E3) * (360/3) * (62/3) = 12,000,000 channels to surf (I'd better get started hu).
I spend 2,000 seconds on each channel so: ~ 2.4E10 seconds or ~ 3,300 years to look ONCE in all my address space
![]()