Staff Systems Engineer - Splunk Administrator - PRE

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Visa's Product Reliability Engineering (PRE) Observability team collaborates with various product development teams, and other teams within Operations & Infrastructure organization to engineer, build and operate the most innovative, reliable, scalable, secure and cost-effective Observability platform solutions to meet VISA customers’ growing needs.

We are looking for talented, curious, and energetic Staff System Engineers who embrace solving complex challenges on a global scale. You will be part of a team of highly talented System engineers who are focused on Visa's Logging Platform. As part of this self-driven team, you will have total ownership of the solutions we provide to our customers focusing on availability, performance, security, and reliability aspects which are critical to Logging platform success. You need to do this all at global scale, as well, so continual, iterative improvements in the process, technology, tools, and automation are essential. In this position, you will be a passionate and talented engineer who can work in a dynamic environment as a member of Agile Scrum teams. Your strong technical leadership, problem-solving abilities, coding, testing and debugging skills are key for success.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Basic Qualifications:
• 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.

Preferred Qualifications:
• 6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
• Splunk Certified Admin
• Extensive working knowledge of Splunk architecture and various components (indexer, forwarder, search head, deployment server), as Splunk system administrator.
• Strong software development fundamentals and skills.
• Setting up Splunk Forwarding for new application tiers introduced into the environment.
• Identifying bad searches/dashboards and partnering with the creators to improve performance.
• Troubleshooting Splunk performance issues / Opening support cases with Splunk.
• Monitor the Splunk infrastructure for capacity planning and optimization.
• Troubleshoot log feeds, field extractions, search time, etc.
• Experience of working with MLTK and/or other data science tools/packages is a plus.
• Experience with Container platforms: Docker, K8S and alternatives.
• Experience with any Observability tools such as Grafana, Prometheus and also tenants of Observability (Monitoring, Logging and/or tracing) is a plus.
• Experience with GitOps/Terraform/Cloud Formations/GCP Deployment Manager
• Experience with any programming language: Java/GoLang/Python is a plus.
• Experience working with Linux environment and Unix scripting.
• Experience with CI/CD: pipeline management with GitHub, Ansible is a plus.
• GCP/AWS Cloud certifications is a plus.
• Experience implementing solutions for low-latency, distributed services using open standard technologies is a plus.
• Strong interpersonal and leadership skills with effective communication (both written and verbal) skills and the ability to present complex ideas in a clear & concise way, a team player with a strong work ethic.

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law, including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for a new hire into this position is 124,700.00 to 180,650.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401 (k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.