From stanislas at nameshield.net Thu Aug 9 08:40:30 2007 From: stanislas at nameshield.net (stan) Date: Thu, 09 Aug 2007 10:40:30 +0200 Subject: [dsc] Problem collector DSC Message-ID: <46BAD2FE.80307@nameshield.net> Hi, I have a problem for counting the total number of query DNS. When I send 320 000 query (10 000 cname) by QueryPerf, I lost 59 query in the XML file client_total My conf file : dataset qname_qtype dns Qname:qname Qtype:qtype queries-only; dataset qname_client dns Qname:qname Client:client_subnet queries-only max-cells=50; dataset qtype_total dns All:null Qtype:qtype queries-only; dataset client_total dns All:null Client:client_subnet queries-only max-cells=50; I think the number of CNAME is too high but why I have this problem ? Thank you Stan From wessels at measurement-factory.com Thu Aug 9 15:46:01 2007 From: wessels at measurement-factory.com (Duane Wessels) Date: Thu, 9 Aug 2007 09:46:01 -0600 (MDT) Subject: [dsc] Problem collector DSC In-Reply-To: <46BAD2FE.80307@nameshield.net> References: <46BAD2FE.80307@nameshield.net> Message-ID: <20070809094332.S43549@measurement-factory.com> On Thu, 9 Aug 2007, stan wrote: > Hi, > > I have a problem for counting the total number of query DNS. > When I send 320 000 query (10 000 cname) by QueryPerf, I lost 59 query > in the XML file client_total > > My conf file : > > dataset qname_qtype dns Qname:qname Qtype:qtype queries-only; > dataset qname_client dns Qname:qname Client:client_subnet queries-only > max-cells=50; > dataset qtype_total dns All:null Qtype:qtype queries-only; > dataset client_total dns All:null Client:client_subnet queries-only > max-cells=50; > > I think the number of CNAME is too high but why I have this problem ? Perhaps the queries were sent faster than the collector process could handle them, so some packets were dropped. Did you happen to notice the CPU usage of the dsc program during your test? You could also try removing the "max-cells=50" options, but if I understand your test correctly, I doubt that will help. Duane W. From andrew.ruthven at catalyst.net.nz Tue Aug 21 23:18:26 2007 From: andrew.ruthven at catalyst.net.nz (Andrew Ruthven) Date: Wed, 22 Aug 2007 11:18:26 +1200 Subject: [dsc] IPv6 Support? Message-ID: <1187738306.1409.29.camel@dirk.catalyst.net.nz> Gidday, Does the current release (200706121022) contain working support for IPv6? I'm trying to use it, but the IPv6 traffic isn't being seen by DSC. Should I try going back to the 200704021841 release? Cheers! -- Andrew Ruthven, Wellington, New Zealand At work: andrew.ruthven at catalyst.net.nz At home: andrew at etc.gen.nz GPG fpr: 34CA 12A3 C6F8 B156 72C2 D0D7 D286 CE0C 0C62 B791 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: From wessels at measurement-factory.com Tue Aug 21 23:37:15 2007 From: wessels at measurement-factory.com (Duane Wessels) Date: Tue, 21 Aug 2007 17:37:15 -0600 (MDT) Subject: [dsc] IPv6 Support? In-Reply-To: <1187738306.1409.29.camel@dirk.catalyst.net.nz> References: <1187738306.1409.29.camel@dirk.catalyst.net.nz> Message-ID: <20070821173625.D1170@measurement-factory.com> On Wed, 22 Aug 2007, Andrew Ruthven wrote: > Gidday, > > Does the current release (200706121022) contain working support for > IPv6? > > I'm trying to use it, but the IPv6 traffic isn't being seen by DSC. > Should I try going back to the 200704021841 release? Yes, it certainly should support IPv6. Are you saying that it was working for you earlier (200704021841) but not working now (200706121022)? Duane W. From andrew.ruthven at catalyst.net.nz Wed Aug 22 00:53:36 2007 From: andrew.ruthven at catalyst.net.nz (Andrew Ruthven) Date: Wed, 22 Aug 2007 12:53:36 +1200 Subject: [dsc] IPv6 Support? In-Reply-To: <20070821173625.D1170@measurement-factory.com> References: <1187738306.1409.29.camel@dirk.catalyst.net.nz> <20070821173625.D1170@measurement-factory.com> Message-ID: <1187744016.1409.35.camel@dirk.catalyst.net.nz> On Tue, 2007-08-21 at 17:37 -0600, Duane Wessels wrote: > On Wed, 22 Aug 2007, Andrew Ruthven wrote: > > Does the current release (200706121022) contain working support for > > IPv6? > > > > I'm trying to use it, but the IPv6 traffic isn't being seen by DSC. > > Should I try going back to the 200704021841 release? > > Yes, it certainly should support IPv6. > > Are you saying that it was working for you earlier (200704021841) > but not working now (200706121022)? It had worked when I tested out 200704021841 after you initially released it, but I haven't tried that version for a little while. I'm just setting it up now and initially tried 200705151838, when that didn't work I upgraded to 200706121022, but that is no go as well. When I run dsc in debug mode it isn't seeing any of the queries over IPv6, but is seeing IPv4 queries through the same interface. Running strace on dsc (with the BPF rule "ip6 and port 53") I'm seeing what appears to be data coming out of pcap, but no debugging info is displayed and the XML files don't contain any data (just boilerplate). Cheers! -- Andrew Ruthven, Wellington, New Zealand At work: andrew.ruthven at catalyst.net.nz At home: andrew at etc.gen.nz GPG fpr: 34CA 12A3 C6F8 B156 72C2 D0D7 D286 CE0C 0C62 B791 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: From wessels at measurement-factory.com Thu Aug 23 06:00:10 2007 From: wessels at measurement-factory.com (Duane Wessels) Date: Thu, 23 Aug 2007 00:00:10 -0600 (MDT) Subject: [dsc] IPv6 Support? In-Reply-To: <1187744016.1409.35.camel@dirk.catalyst.net.nz> References: <1187738306.1409.29.camel@dirk.catalyst.net.nz> <20070821173625.D1170@measurement-factory.com> <1187744016.1409.35.camel@dirk.catalyst.net.nz> Message-ID: <20070822235821.V1170@measurement-factory.com> On Wed, 22 Aug 2007, Andrew Ruthven wrote: > When I run dsc in debug mode it isn't seeing any of the queries over > IPv6, but is seeing IPv4 queries through the same interface. Running It works for me on FreeBSD. Here's what I get with debug mode: handle_ipv6() ::1:54355 QT=12 QC=1 len=40 qname=1.0.0.127.in-addr.arpa tld=arpa opcode=0 rcode=0 malformed=0 qr=0 rd=1 handle_ipv6() handle_ipv6() ::1:54355 QT=12 QC=1 len=40 qname=1.0.0.127.in-addr.arpa tld=arpa opcode=0 rcode=0 malformed=0 qr=0 rd=1 handle_ipv6() What's your operating system? Duane W. From andrew.ruthven at catalyst.net.nz Thu Aug 23 06:16:28 2007 From: andrew.ruthven at catalyst.net.nz (Andrew Ruthven) Date: Thu, 23 Aug 2007 18:16:28 +1200 Subject: [dsc] IPv6 Support? In-Reply-To: <20070822235821.V1170@measurement-factory.com> References: <1187738306.1409.29.camel@dirk.catalyst.net.nz> <20070821173625.D1170@measurement-factory.com> <1187744016.1409.35.camel@dirk.catalyst.net.nz> <20070822235821.V1170@measurement-factory.com> Message-ID: <1187849788.6784.5.camel@cyclops.etc.gen.nz> Hi Duane, On Thu, 2007-08-23 at 00:00 -0600, Duane Wessels wrote: > > On Wed, 22 Aug 2007, Andrew Ruthven wrote: > > > When I run dsc in debug mode it isn't seeing any of the queries over > > IPv6, but is seeing IPv4 queries through the same interface. Running > > It works for me on FreeBSD. Here's what I get with debug mode: [snip] > What's your operating system? I'm running Linux (Debian Etch) and I'm getting absolutely no output. If I strace the process, then I see some data being handed into dsc from recvfrom, but no output is displayed. Cheers! -- Andrew Ruthven, Wellington, New Zealand Catalyst IT Limited --> http://www.catalyst.net.nz At work: andrew.ruthven at catalyst.net.nz At home: andrew at etc.gen.nz GPG fpr: 34CA 12A3 C6F8 B156 72C2 D0D7 D286 CE0C 0C62 B791 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: From andrew.ruthven at catalyst.net.nz Mon Aug 27 01:49:18 2007 From: andrew.ruthven at catalyst.net.nz (Andrew Ruthven) Date: Mon, 27 Aug 2007 01:49:18 +0000 Subject: [dsc] IPv6 Support? In-Reply-To: <1187849788.6784.5.camel@cyclops.etc.gen.nz> References: <1187738306.1409.29.camel@dirk.catalyst.net.nz> <20070821173625.D1170@measurement-factory.com> <1187744016.1409.35.camel@dirk.catalyst.net.nz> <20070822235821.V1170@measurement-factory.com> <1187849788.6784.5.camel@cyclops.etc.gen.nz> Message-ID: <1188179358.3995.14.camel@dirk.catalyst.net.nz> Hi Duane, > I'm running Linux (Debian Etch) and I'm getting absolutely no output. > If I strace the process, then I see some data being handed into dsc from > recvfrom, but no output is displayed. I've just been digging into things using gdb, and I've found that in pcap.c the packets are being dropped in handle_ether function, because the is_ethertype_ip check is failing. It appears that I don't have ETHERTYPE_IPV6 defined on my Linux boxes. Adding: #ifndef ETHERTYPE_IPV6 #define ETHERTYPE_IPV6 0x86dd #endif To pcap.h resolved my issue. Thanks for your help! (Now, to see how the presenter handles this data!) -- Andrew Ruthven, Wellington, New Zealand At work: andrew.ruthven at catalyst.net.nz At home: andrew at etc.gen.nz GPG fpr: 34CA 12A3 C6F8 B156 72C2 D0D7 D286 CE0C 0C62 B791 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part URL: