Re: [casper] casper Digest, Vol 90, Issue 10
Hi all, For those interested in White Rabbit, Xilinx have an article in their Xcell journal (91). The link is here http://issuu.com/xcelljournal/docs/xcell_journal_issue_91/18?e. regards, Andrew On Thu, May 7, 2015 at 1:45 AM, casper-requ...@lists.berkeley.edu wrote: Send casper mailing list submissions to casper@lists.berkeley.edu To subscribe or unsubscribe via the World Wide Web, visit https://calmail.berkeley.edu/manage/list/listinfo/casper@lists.berkeley.edu or, via email, send a message with subject or body 'help' to casper-requ...@lists.berkeley.edu You can reach the person managing the list at casper-ow...@lists.berkeley.edu When replying, please edit your Subject line so it is more specific than Re: Contents of casper digest... Today's Topics: 1. Re: Timing distribution over fiber (Jack Hickish) -- Message: 1 Date: Wed, 06 May 2015 23:45:53 + From: Jack Hickish jackhick...@gmail.com Subject: Re: [casper] Timing distribution over fiber To: Johan Burger jbur...@ska.ac.za, Michael Inggs miki...@gmail.com,Bob Stricklin bstr...@n5brg.com, Sias Malan s...@ska.ac.za, Renier Siebrits ren...@ska.ac.za, Francois Kapp franc...@ska.ac.za, Etienne Bauermeister etie...@ska.ac.za Cc: Simon Lewis simonacle...@hotmail.com, Casper Lists casper@lists.berkeley.edu,Thomas Abbott tabb...@ska.ac.za, Stephan Sandenberg ssandenbe...@gmail.com Message-ID: CAG1GKS=5fWeJ+quOj= gj_rd7qgtngc2z_07abtx7nwjhojw...@mail.gmail.com Content-Type: text/plain; charset=utf-8 On Wed, 6 May 2015 at 07:35 Johan Burger jbur...@ska.ac.za wrote: Hi there, Do you maybe have any idea of requirement specifications for the HERA's RF phase stability and time (?) - this might determine what technology could be appropriate. Hi Johan, Thanks for your response. We're sampling at 500 MHz, so we'd like to have a stability of few degrees, preferably over timescales of many hours but perhaps more reasonably on a calibration cadence of O(10 minutes) PPS is not such a big deal, and synchronization to a couple of ADC clock cycles is probably fine. We're investigating simple-ish ways to calibrate these out with signal injection. We at SKA Africa have after some iteration come up, with a precision RF distribution system for many antennas. The type of laser and integrated modulator have been proven in the field on large arrays (not just MeerKAT). The RF can be directly transmitted (in our case up to 2-3 GHz limited by our synthesizer - the precise frequency is 1.712GHz). 500MHz RF over fibre can be done by this as well. There is conditioning of the RF taking place on MeerKAT at the receiving end. As Jason said, not any or all modules really do the job properly - we converged on a solution after testing, that implicitly included modules evaluated from KAT-7 days, and more recent modules from other manufacturers. Low precision timing ~100ns can indeed be done using PTP. If PPS is required instead of an Ethernet package a special conversion board (PCIe) is necessary. This is really enough for fringe finding - used in MeerKAT S-band for example. That digitiser is mounted in an RFI shielded pedestal of the antenna though. We supply the high precision PPS using our custom system as described below. For our L-band digitisers mounted on the outside we had to come up with special low power, low cost, high accuracy solution - this is being implemented by Renier and Etienne and others here at SKA Africa (so a joint effort by our time and frequency and digitiser team). The reason is that White Rabbit is not compatible with 10Gbe links used on this system. Furthermore Ethernet is actually quite noisy as per MeerKAT measurements, and White Rabbit and PTP uses that (and with highish power consumption and largish board size), and is not preferable in a high purity clock signal and PPS module. We found that measurement based PPS system will meet our requirements though, for stabilized links and provides us with accurate absolute time references at antennas, using analog methodologies. This for example being important in pulsar science. I am not sure what level of RFI shielding you would be able to mount around modules, but as said RFI from Ethernet has certainly been found to be an RFI culprit, and cannot be therefore be used in MeerKAT close to sensitive modules - and needs to separately shielded. This therefore means that if PPS is generated from White Rabbit/PTP there is still some uncertain propagation paths left (important at least for MeerKAT) up to the point of digitization where a timing edge is inserted. We are using seperate fibres for PPS and RF, to further limit self-RFI and as it was found that requirements could only be met
Re: [casper] Roach1 not working
Hi All, I used the usb wriggler and ito load the bootloader and now I am seeing data comming out of the serial terminal as before. But the roach is still not booting properly. I am trying to boot the roach through nfs boot and I am seeing this at the terminal. Please can any tell me how to fix this error. Thanks Nishanth U-Boot 2008.10-svn3231 (Jul 15 2010 - 14:58:38) CPU: AMCC PowerPC 440EPx Rev. A at 533.333 MHz (PLB=133, OPB=66, EBC=66 MHz) No Security/Kasumi support Bootstrap Option C - Boot ROM Location EBC (16 bits) 32 kB I-Cache 32 kB D-Cache Board: Roach I2C: ready DTT: 1 FAILED INIT DRAM: (spd v1.2) dram: notice: ecc ignored 1 GB FLASH: 64 MB USB: Host(int phy) Device(ext phy) Net: ppc_4xx_eth0 Roach Information Serial Number:040114 Monitor Revision: 8.3.1698 CPLD Revision:8.0.1588 type run netboot to boot via dhcp+tftp+nfs type run soloboot to run from flash without network type run mmcboot to boot using filesystem on mmc/sdcard type run usbboot to boot using filesystem on usb type run bit to run tests Hit any key to stop autoboot: 0 Waiting for PHY auto negotiation to complete done ENET Speed is 1000 Mbps - FULL duplex connection (EMAC0) BOOTP broadcast 1 *** Unhandled DHCP Option in OFFER/ACK: 28 *** Unhandled DHCP Option in OFFER/ACK: 28 DHCP client bound to address 192.168.40.8 Using ppc_4xx_eth0 device TFTP from server 192.168.40.1; our IP address is 192.168.40.8 Filename 'uImage'. Load address: 0x40 Loading: # ## done Bytes transferred = 1390149 (153645 hex) WARNING: adjusting available memory to 3000 ## Booting kernel from Legacy Image at 0040 ... Image Name: Linux-2.6.25-svn3489 Image Type: PowerPC Linux Kernel Image (gzip compressed) Data Size:1390085 Bytes = 1.3 MB Load Address: Entry Point: Verifying Checksum ... OK Uncompressing Kernel Image ... OK id mach(): done MMU:enter MMU:hw init MMU:mapin MMU:setio MMU:exit setup_arch: enter setup_arch: bootmem ocp: exit arch: exit Linux version 2.6.25-svn3489 (dave@lapster) (gcc version 4.2.2) #6 Fri Aug 12 09:36:28 SAST 2011 AMCC PowerPC 440EPx Roach Platform Zone PFN ranges: DMA 0 - 262143 Normal 262143 - 262143 Movable zone start PFN for each node early_node_map[1] active PFN ranges 0:0 - 262143 Built 1 zonelists in Zone order, mobility grouping on. Total pages: 260096 Kernel command line: console=ttyS0,115200 mtdparts=physmap-flash.0:1792k(linux),256k@0x1c(fdt),8192k@0x20 (root),p PID hash table entries: 4096 (order: 12, 16384 bytes) console [ttyS0] enabled Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) Memory: 1036416k available (2084k kernel code, 720k data, 132k init, 0k highmem) Mount-cache hash table entries: 512 BORPH version CVS-$Revision: 1.10 $ Initialized net_namespace: 152 bytes NET: Registered protocol family 16 PCI: Probing PCI hardware SCSI subsystem initialized usbcore: registered new interface driver usbfs usbcore: registered new interface driver hub usbcore: registered new device driver usb NET: Registered protocol family 2 IP route cache hash table entries: 32768 (order: 5, 131072 bytes) TCP established hash table entries: 131072 (order: 8, 1048576 bytes) TCP bind hash table entries: 65536 (order: 6, 262144 bytes) TCP: Hash tables configured (established 131072 bind 65536) TCP reno registered hwrtype_roach version CVS-$Revision: 1.1 $ registered JFFS2 version 2.2. (NAND) ��� 2001-2006 Red Hat, Inc. io scheduler noop registered (default) Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled serial8250: ttyS0 at MMIO 0x0 (irq = 0) is a 16550A serial8250: ttyS1 at MMIO 0x0 (irq = 1) is a 16550A serial8250: ttyS2 at MMIO 0x0 (irq = 35) is a 16550A serial8250: ttyS3 at MMIO 0x0 (irq = 36) is a 16550A brd: module loaded PPC 4xx OCP EMAC driver, version 3.54 mal0: initialized, 2 TX channels, 2 RX channels rgmii0: input 0 in RGMII mode eth0: emac0, MAC 02:00:00:04:01:14 eth0: found Generic MII PHY (0x1e) rgmii0: input 1 in RGMII mode emac1: can't find PHY! tun: Universal TUN/TAP device driver, 1.6 tun: (C) 1999-2004 Max Krasnyansky m...@qualcomm.com Driver 'sd' needs updating - please use bus_type methods physmap platform flash device: 0400 at fc00 physmap-flash.0: Found 1 x16 devices at 0x0 in 16-bit bank Amd/Fujitsu Extended Query Table at 0x0040 physmap-flash.0: CFI does not contain boot bank location. Assuming top. number of CFI chips: 1 cfi_cmdset_0002: Disabling erase-suspend-program due to code brokenness. mtd: bad character after partition (f) 6 cmdlinepart partitions found on MTD device physmap-flash.0 Creating 6 MTD partitions on physmap-flash.0: 0x-0x001c : linux 0x001c-0x0020 : fdt 0x0020-0x00a0 : root
Re: [casper] Test ADC-10Gb Ethernet port
Thanks Simon. I have the big problem that I always start my learning upside down. I always start with the most difficult :-) I will try to modify these tutorials to use IBOB. I hope to get lucky ... Rolando Paz 2015-05-07 16:26 GMT-06:00 Simon Scott simonsc...@berkeley.edu: Rolando, I would start with the 10Gb Ethernet tutorials on the Casper wiki: https://casper.berkeley.edu/wiki/ROACH_10GbE_tutorial https://casper.berkeley.edu/wiki/Tutorial_10GbE I learnt how to use the 10GBE from these tutorials. Please remember that the tutorials are for Roach, not IBOB, so you may need to make some changes to get them to work. Regards, Simon On 05/07/2015 03:05 PM, Rolando Paz wrote: Hi All Does anyone know where I can get a model file to test the 10Gb ethernet port? Something like the attached image. My intention is to test the CX4 port of IBOB with a simple design. Best Regards RP
[casper] Test ADC-10Gb Ethernet port
Hi All Does anyone know where I can get a model file to test the 10Gb ethernet port? Something like the attached image. My intention is to test the CX4 port of IBOB with a simple design. Best Regards RP
Re: [casper] Test ADC-10Gb Ethernet port
Rolando, I would start with the 10Gb Ethernet tutorials on the Casper wiki: https://casper.berkeley.edu/wiki/ROACH_10GbE_tutorial https://casper.berkeley.edu/wiki/Tutorial_10GbE I learnt how to use the 10GBE from these tutorials. Please remember that the tutorials are for Roach, not IBOB, so you may need to make some changes to get them to work. Regards, Simon On 05/07/2015 03:05 PM, Rolando Paz wrote: Hi All Does anyone know where I can get a model file to test the 10Gb ethernet port? Something like the attached image. My intention is to test the CX4 port of IBOB with a simple design. Best Regards RP
Re: [casper] casper Digest, Vol 90, Issue 10
Thanks for the link, Andrew! On Thu, 7 May 2015 at 05:09 Andrew Vdb avd...@gmail.com wrote: Hi all, For those interested in White Rabbit, Xilinx have an article in their Xcell journal (91). The link is here http://issuu.com/xcelljournal/docs/xcell_journal_issue_91/18?e. regards, Andrew On Thu, May 7, 2015 at 1:45 AM, casper-requ...@lists.berkeley.edu wrote: Send casper mailing list submissions to casper@lists.berkeley.edu To subscribe or unsubscribe via the World Wide Web, visit https://calmail.berkeley.edu/manage/list/listinfo/casper@lists.berkeley.edu or, via email, send a message with subject or body 'help' to casper-requ...@lists.berkeley.edu You can reach the person managing the list at casper-ow...@lists.berkeley.edu When replying, please edit your Subject line so it is more specific than Re: Contents of casper digest... Today's Topics: 1. Re: Timing distribution over fiber (Jack Hickish) -- Message: 1 Date: Wed, 06 May 2015 23:45:53 + From: Jack Hickish jackhick...@gmail.com Subject: Re: [casper] Timing distribution over fiber To: Johan Burger jbur...@ska.ac.za, Michael Inggs miki...@gmail.com,Bob Stricklin bstr...@n5brg.com, Sias Malan s...@ska.ac.za, Renier Siebrits ren...@ska.ac.za, Francois Kapp franc...@ska.ac.za, Etienne Bauermeister etie...@ska.ac.za Cc: Simon Lewis simonacle...@hotmail.com, Casper Lists casper@lists.berkeley.edu,Thomas Abbott tabb...@ska.ac.za , Stephan Sandenberg ssandenbe...@gmail.com Message-ID: CAG1GKS=5fWeJ+quOj= gj_rd7qgtngc2z_07abtx7nwjhojw...@mail.gmail.com Content-Type: text/plain; charset=utf-8 On Wed, 6 May 2015 at 07:35 Johan Burger jbur...@ska.ac.za wrote: Hi there, Do you maybe have any idea of requirement specifications for the HERA's RF phase stability and time (?) - this might determine what technology could be appropriate. Hi Johan, Thanks for your response. We're sampling at 500 MHz, so we'd like to have a stability of few degrees, preferably over timescales of many hours but perhaps more reasonably on a calibration cadence of O(10 minutes) PPS is not such a big deal, and synchronization to a couple of ADC clock cycles is probably fine. We're investigating simple-ish ways to calibrate these out with signal injection. We at SKA Africa have after some iteration come up, with a precision RF distribution system for many antennas. The type of laser and integrated modulator have been proven in the field on large arrays (not just MeerKAT). The RF can be directly transmitted (in our case up to 2-3 GHz limited by our synthesizer - the precise frequency is 1.712GHz). 500MHz RF over fibre can be done by this as well. There is conditioning of the RF taking place on MeerKAT at the receiving end. As Jason said, not any or all modules really do the job properly - we converged on a solution after testing, that implicitly included modules evaluated from KAT-7 days, and more recent modules from other manufacturers. Low precision timing ~100ns can indeed be done using PTP. If PPS is required instead of an Ethernet package a special conversion board (PCIe) is necessary. This is really enough for fringe finding - used in MeerKAT S-band for example. That digitiser is mounted in an RFI shielded pedestal of the antenna though. We supply the high precision PPS using our custom system as described below. For our L-band digitisers mounted on the outside we had to come up with special low power, low cost, high accuracy solution - this is being implemented by Renier and Etienne and others here at SKA Africa (so a joint effort by our time and frequency and digitiser team). The reason is that White Rabbit is not compatible with 10Gbe links used on this system. Furthermore Ethernet is actually quite noisy as per MeerKAT measurements, and White Rabbit and PTP uses that (and with highish power consumption and largish board size), and is not preferable in a high purity clock signal and PPS module. We found that measurement based PPS system will meet our requirements though, for stabilized links and provides us with accurate absolute time references at antennas, using analog methodologies. This for example being important in pulsar science. I am not sure what level of RFI shielding you would be able to mount around modules, but as said RFI from Ethernet has certainly been found to be an RFI culprit, and cannot be therefore be used in MeerKAT close to sensitive modules - and needs to separately shielded. This therefore means that if PPS is generated from White Rabbit/PTP there is still some uncertain propagation paths left (important at least for MeerKAT) up to the point of digitization where a timing edge is inserted. We are using
[casper] Update to github valon code
Hi everyone, I've added a new branch to the github repository, entitled experimental, for some new development ideas I've been tossing around. Within, so far, I've added a way to set all the register fields present on the valon via the Python interface (only, for the moment). These were previously inaccessible without using the windows interface or doing your own bit-banging. I cannot emphasize how utterly and completely untested this code is. I don't have access to a valon anymore, so this is not even close to approved for production. That said, I hope that somebody with a valon will take the time to review the code, verify that I haven't made a horrible typo in the bitfield definitions or the main class, and maybe throw caution to the wind and use it to read and write some registers. The register definitions are in valon_registers.py, and derive their names from the register map in the interface document Dan sent around. I don't know what many (most) of the options do, or what the valid values they can be set to are. Once again, buyer beware. I'd love to hear that people use this, but I don't want to be the guy who bricked a bunch of synthesizers. There is a new method, _get_all_registers, which returns 5 structure like objects (of type registerX_t). Inside each are the named contents of the register. e.g., r0, r1, r2, r3, r4, r5 = vs._get_all_registers(SYNTH_A) type(r0) class 'valon_registers.register0_t' r0.ncount 160 type(r1) class 'valon_registers.register1_t' r1.mod 0 There is a matching method for setting all registers, _set_all_registers, which takes 5 of the same types returned from _get. _set will overwrite all the current settings with whatever is specified, so I'd highly recommend only using it with _get and making sure you know what you're doing. :) I've also turned on the verification of checksums, which I originally completely forgot about handling in the Python code. Oops. Cheers, --Patrick
[casper] support for 40G infiniband?
Hi list, there are some plans for another hybrid (hw/sw) wideband spectrometer and multi-beam correlator. Data input is the main issue, options are network attached samplers versus PCIe cards. Has any casperite by chance been working on 40 Gbps? Might it be possible to have Roach2 CX4 run at 40 GbE and interface to Infiniband cards? Or would this require the HXT version of Virtex-6 (in addition to probably extra work on the ten_gbe core)? cheers, Jan
