I used Deep Log Analyzer to monitor my site visits. What I noticed now, is that there is way too much traffic reported than it actually should be reported based on google analytics. I started to use GA now but I need to create a clean report from April 2017 until November 2017 based on the iis logs.
I got all of the log files from IIS. But now I'm looking for a way to filter spam like /wp-admin Brute-Force stuff and to monitor just the 'real' visitors data without bots and internal refferers.
Is there any better tool for that kind of log reporting or is there a way to achieve that goal in Deep Log Analyzer?
I tried to filter the reports but It still seems to have too much hits.
I just need the following information:
Total Visits, Amount of users, average session time, and device (if mobile or desktop)
thanks for recommendations and help
EDIT: best solution I found: http://www.weblogexpert.com/
I would look at Log Parser Studio:
https://blogs.technet.microsoft.com/exchange/2012/03/07/introducing-log-parser-studio/
It allows SQL like log querying and filtering.
Edit:
Possible new link: https://techcommunity.microsoft.com/t5/exchange-team-blog/log-parser-studio-2-0-is-now-available/ba-p/593266
I realize Im a bit late to the party but, having tried a bunch of freeware tools out there I can say with certainty that HttpLogBrowser (https://www.iis.net/downloads/community/2017/04/httplogbrowser) is the best of the bunch
Really quick to load up one or more log files for analysis
Not sluggish when browsing/searching/filtering the data (despite using very little memory)
Extremely useful visual representations of logged data
You could do this with the free edition of SpectX. Download and point it to your IIS log folder. Tutorials and sample queries:
Parsing IIS logs
Analyzing IIS Logs
Analyzing IIS logs: Microsoft Exchange, OWA and ActiveSync Activities
A very basic way of filtering out bots is to configure SpectX to access Maxmind's GeoIP databases and then use the filter_out command. For example:
| filter_out(asname(c_ip) = ‘AS15169 Google LLC’ and cs_user_agent like ‘%Googlebot/%‘)
| filter_out(asname(c_ip) = ‘AS8075 Microsoft Corporation’ and cs_user_agent like ‘%BingPreview/%‘)
| filter_out(asname(c_ip) = ‘AS8075 Microsoft Corporation’ and cs_user_agent like ‘%bingbot/%‘)
| filter_out(asname(c_ip) = ‘AS32934 Facebook, Inc.’ and cs_user_agent like ‘%facebookexternalhi%‘)
| filter_out(asname(c_ip) = ‘AS14618 Amazon.com, Inc.’ and cs_user_agent like ‘%SMTBot/%‘)
| filter_out(asname(c_ip) = ‘AS714 Apple Inc.’ and cs_user_agent like ‘%Applebot/%‘)
| filter_out(asname(c_ip) = ‘AS13238 YANDEX LLC’ and cs_user_agent like ‘%YandexBot/%‘)
| filter_out(asname(c_ip) = ‘AS13238 YANDEX LLC’ and cs_user_agent like ‘%YandexMobileBot/%’)
Related
I'd like to use Google Analytics to track usage of a command line Node app. Tracking will be strictly opt-in. I'd like to track basic usage, plus which operating system and version of Node was used.
I've found the Measurement Protocol, but I'm wondering whats the best way to set up Google Analytics.
You can choose from Web or App - App seems the best fit, but then I'm sent to Firebase to set up an iOS, Android or Web app. None of these are correct. So is 'Web' the best way to track my app usage? Or is Google Analytics not the right approach?
Seems like the best approach is Google Measurement Protocol. There's a Node library for it.
Really Google Analytics is completely designed around web apps and more recently mobile apps, it has concepts like "page views" which don't make sense for CLIs, and Firebase Analytics is only for Android and iOS.
You might be able to shoehorn he CLI use case for some purposes. Alternatively, you could consider using a cloud database like Firebase real-time DB to capture your own events.
Google analytics really isnt designed for something like this. You have only two options web app where everything is page based. http://example.com/hello.php vs using a mobile app where everything is screen based. Home, about, help.
I have done this before with several console applications, a custom SSIS task (dll) and an arduino project. I chose mobile application mainly because i thought it was closer. I know of someone who did the same with an actions on google project.
In the end what you use will be up to you. Just consider what it is you want to track exactly and lay it out before you start.
If you choose mobile make sure you send Screen views and not page views. The Google analytics website is split you cant mix and match the hit type.
Workaround for createing moble account without firebase.
create a new web property on Google analytics type Web
create a new view under that web property type mobile.
We made Console Cat for this exact purpose! It's built from the ground up to track telemetry / analytics for CLIs including things like flags, command duration, version, etc.
I'm creating a UWP application that will be used exclusively on rugged Win10 tablets by a group of initially 10-20. If things go well it will be expanded to 100 users. These users are employees of our company, but will be remotely located.
Currently, with the test tablets, I am pushing the packages in google drive and manually copying them to the tablets, unzipping and executing the ps file on the tablet. This is way to complicated for even a beta test group of our users.
I'm looking for short-term/long-term recommendations for deployment. Someone mentioned SCCM to me and I've read a little, but that seems like quite a major endeavor to host. I would prefer something like a "private store" concept, but I can't find anything like that.
You can create a private store for your company. The best solution is probably to use Windows Store for Business. http://www.microsoft.com/en-us/business-store
Microsoft Azure Active Directory (AD) accounts for your employees are needed if you select this solution.
An alternative way is to use HockeyApp http://hockeyapp.net to deploy your application.
According to your description, HockeyApp should meet your requirement. Via HockeyApp, you can upload and distribute builds for beta or enterprise distribution using our web UI, or our API. HockeyApp also supports build servers like Jenkins or Visual Studio Team Services. Don't forget to upload your dSYM or
mapping.txt to get readable crash reports.
With HockeySDK for UWP integrated, you can also:
Integrate our open-source SDK to:
Collect crash reports
Show update alerts for new beta builds
Add a feedback view directly into your app
For more information, please visit support.hockeyapp.net.
We upgraded to Universal Analytics about a year ago and since upgrading our Site Search isn't displaying the keywords within our Analytics account, or even tracking the number of times it is used.
This is a problem as a marketer as I like to know what people are looking for so that I can provide them relevant content.
All I can find on the Google blog is this:
https://support.google.com/customsearch/answer/2715510
'At this time, Google Custom Search Engine, is not compatible with Universal Analytics.'
Has anyone got any suggestions as to how I can get this data back? Are there any other custom site searches that I could use instead? Are Google even looking at this?
Google CSE is using old _gaq calls for analytics, it can be mimicked by adding following code line at the end of universal GA snippet:
_gaq={push:function(){ga('send','pageview',arguments[0][1]);}}
View - View settings - Site search settings is on and correctly tuned?
Has anyone has done Eventbrite integration with an Expression Engine site? We'd like to set up events with Eventbrite and have them handle all ticket management. But we'd like to be able to display the events within the Expression Engine site and then enable users to click on the link to be redirected to Eventbrite. I've viewed the API and it looks like we can create custom EE pages with the API.
More importantly I'd like to let users search for events from our main site.
Has anyone done this type of work and have any hints or resources?
Thanks.
Todd Perkins got started on a module for this some time ago, but there hasn't been any action on it since then. Could be a good starting point for you though.
https://github.com/toddperkins/eventbrite
Eventbrite has a great PHP-based API client library that should be able cover all of your API interaction needs.
These PHP examples might be useful as well:
https://github.com/ryanjarvinen/eventbrite.php/tree/master/examples
http://eventbrite.github.com/#examples
Please let #EventbriteAPI know if you make any major progress on this project. I'm sure they would love to add an Expression Engine integration to their open source projects list and application showcase!
I would like to extract the data and event name from a google calendar then show it as plain text. When ever the calendar is updated I would like the text to reflect this. It will be a part of a web site that I am working on.
What would be a good way to go about this?
The GData apis are what you're looking for. There are APIs for .NET, PHP, and Java at least (having used all, they are all fine)[1]. I have used the Zend Framework's implementation [2] to great success making a timeclock application totaling the hours the members in our organization recorded on their Google calendars, and the .NET framework is just as good. For a website, this is the way to go.
There is also a nifty command line tool, though I have not has as much success with it (Both *nix and Windows command line, though of course you'll have much more processing power in *nix ;))
[1] http://code.google.com/apis/gdata/docs/client-libraries.html
[2] http://framework.zend.com/manual/en/zend.gdata.html
[3] http://code.google.com/p/googlecl/
[Edit]
The project I mentioned for building a timeclock is available at http://code.google.com/p/gcaltimeclock/
The files you are probably most interested in are http://code.google.com/p/gcaltimeclock/source/browse/application/controllers/calendars.php and http://code.google.com/p/gcaltimeclock/source/browse/application/views/calendars/timesheets.php