1b96e6615SThomas Richter // SPDX-License-Identifier: GPL-2.0 2b96e6615SThomas Richter /* 3b96e6615SThomas Richter * Copyright IBM Corp. 2018 4b96e6615SThomas Richter * Auxtrace support for s390 CPU-Measurement Sampling Facility 5b96e6615SThomas Richter * 6b96e6615SThomas Richter * Author(s): Thomas Richter <tmricht@linux.ibm.com> 733d9e183SThomas Richter * 833d9e183SThomas Richter * Auxiliary traces are collected during 'perf record' using rbd000 event. 933d9e183SThomas Richter * Several PERF_RECORD_XXX are generated during recording: 1033d9e183SThomas Richter * 1133d9e183SThomas Richter * PERF_RECORD_AUX: 1233d9e183SThomas Richter * Records that new data landed in the AUX buffer part. 1333d9e183SThomas Richter * PERF_RECORD_AUXTRACE: 1433d9e183SThomas Richter * Defines auxtrace data. Followed by the actual data. The contents of 1533d9e183SThomas Richter * the auxtrace data is dependent on the event and the CPU. 1633d9e183SThomas Richter * This record is generated by perf record command. For details 1733d9e183SThomas Richter * see Documentation/perf.data-file-format.txt. 1833d9e183SThomas Richter * PERF_RECORD_AUXTRACE_INFO: 1933d9e183SThomas Richter * Defines a table of contains for PERF_RECORD_AUXTRACE records. This 2033d9e183SThomas Richter * record is generated during 'perf record' command. Each record contains up 2133d9e183SThomas Richter * to 256 entries describing offset and size of the AUXTRACE data in the 2233d9e183SThomas Richter * perf.data file. 2333d9e183SThomas Richter * PERF_RECORD_AUXTRACE_ERROR: 2433d9e183SThomas Richter * Indicates an error during AUXTRACE collection such as buffer overflow. 2533d9e183SThomas Richter * PERF_RECORD_FINISHED_ROUND: 2633d9e183SThomas Richter * Perf events are not necessarily in time stamp order, as they can be 2733d9e183SThomas Richter * collected in parallel on different CPUs. If the events should be 2833d9e183SThomas Richter * processed in time order they need to be sorted first. 2933d9e183SThomas Richter * Perf report guarantees that there is no reordering over a 3033d9e183SThomas Richter * PERF_RECORD_FINISHED_ROUND boundary event. All perf records with a 3133d9e183SThomas Richter * time stamp lower than this record are processed (and displayed) before 3233d9e183SThomas Richter * the succeeding perf record are processed. 3333d9e183SThomas Richter * 3433d9e183SThomas Richter * These records are evaluated during perf report command. 3533d9e183SThomas Richter * 3633d9e183SThomas Richter * 1. PERF_RECORD_AUXTRACE_INFO is used to set up the infrastructure for 3733d9e183SThomas Richter * auxiliary trace data processing. See s390_cpumsf_process_auxtrace_info() 3833d9e183SThomas Richter * below. 3933d9e183SThomas Richter * Auxiliary trace data is collected per CPU. To merge the data into the report 4033d9e183SThomas Richter * an auxtrace_queue is created for each CPU. It is assumed that the auxtrace 4133d9e183SThomas Richter * data is in ascending order. 4233d9e183SThomas Richter * 4333d9e183SThomas Richter * Each queue has a double linked list of auxtrace_buffers. This list contains 4433d9e183SThomas Richter * the offset and size of a CPU's auxtrace data. During auxtrace processing 4533d9e183SThomas Richter * the data portion is mmap()'ed. 4633d9e183SThomas Richter * 4733d9e183SThomas Richter * To sort the queues in chronological order, all queue access is controlled 4833d9e183SThomas Richter * by the auxtrace_heap. This is basicly a stack, each stack element has two 4933d9e183SThomas Richter * entries, the queue number and a time stamp. However the stack is sorted by 5033d9e183SThomas Richter * the time stamps. The highest time stamp is at the bottom the lowest 5133d9e183SThomas Richter * (nearest) time stamp is at the top. That sort order is maintained at all 5233d9e183SThomas Richter * times! 5333d9e183SThomas Richter * 5433d9e183SThomas Richter * After the auxtrace infrastructure has been setup, the auxtrace queues are 5533d9e183SThomas Richter * filled with data (offset/size pairs) and the auxtrace_heap is populated. 5633d9e183SThomas Richter * 5733d9e183SThomas Richter * 2. PERF_RECORD_XXX processing triggers access to the auxtrace_queues. 5833d9e183SThomas Richter * Each record is handled by s390_cpumsf_process_event(). The time stamp of 5933d9e183SThomas Richter * the perf record is compared with the time stamp located on the auxtrace_heap 6033d9e183SThomas Richter * top element. If that time stamp is lower than the time stamp from the 6133d9e183SThomas Richter * record sample, the auxtrace queues will be processed. As auxtrace queues 6233d9e183SThomas Richter * control many auxtrace_buffers and each buffer can be quite large, the 6333d9e183SThomas Richter * auxtrace buffer might be processed only partially. In this case the 6433d9e183SThomas Richter * position in the auxtrace_buffer of that queue is remembered and the time 6533d9e183SThomas Richter * stamp of the last processed entry of the auxtrace_buffer replaces the 6633d9e183SThomas Richter * current auxtrace_heap top. 6733d9e183SThomas Richter * 6833d9e183SThomas Richter * 3. Auxtrace_queues might run of out data and are feeded by the 6933d9e183SThomas Richter * PERF_RECORD_AUXTRACE handling, see s390_cpumsf_process_auxtrace_event(). 7033d9e183SThomas Richter * 7133d9e183SThomas Richter * Event Generation 7233d9e183SThomas Richter * Each sampling-data entry in the auxilary trace data generates a perf sample. 7333d9e183SThomas Richter * This sample is filled 7433d9e183SThomas Richter * with data from the auxtrace such as PID/TID, instruction address, CPU state, 7533d9e183SThomas Richter * etc. This sample is processed with perf_session__deliver_synth_event() to 7633d9e183SThomas Richter * be included into the GUI. 7733d9e183SThomas Richter * 7833d9e183SThomas Richter * 4. PERF_RECORD_FINISHED_ROUND event is used to process all the remaining 7933d9e183SThomas Richter * auxiliary traces entries until the time stamp of this record is reached 8033d9e183SThomas Richter * auxtrace_heap top. This is triggered by ordered_event->deliver(). 8133d9e183SThomas Richter * 8233d9e183SThomas Richter * 8333d9e183SThomas Richter * Perf event processing. 8433d9e183SThomas Richter * Event processing of PERF_RECORD_XXX entries relies on time stamp entries. 8533d9e183SThomas Richter * This is the function call sequence: 8633d9e183SThomas Richter * 8733d9e183SThomas Richter * __cmd_report() 8833d9e183SThomas Richter * | 8933d9e183SThomas Richter * perf_session__process_events() 9033d9e183SThomas Richter * | 9133d9e183SThomas Richter * __perf_session__process_events() 9233d9e183SThomas Richter * | 9333d9e183SThomas Richter * perf_session__process_event() 9433d9e183SThomas Richter * | This functions splits the PERF_RECORD_XXX records. 9533d9e183SThomas Richter * | - Those generated by perf record command (type number equal or higher 9633d9e183SThomas Richter * | than PERF_RECORD_USER_TYPE_START) are handled by 9733d9e183SThomas Richter * | perf_session__process_user_event(see below) 9833d9e183SThomas Richter * | - Those generated by the kernel are handled by 9933d9e183SThomas Richter * | perf_evlist__parse_sample_timestamp() 10033d9e183SThomas Richter * | 10133d9e183SThomas Richter * perf_evlist__parse_sample_timestamp() 10233d9e183SThomas Richter * | Extract time stamp from sample data. 10333d9e183SThomas Richter * | 10433d9e183SThomas Richter * perf_session__queue_event() 10533d9e183SThomas Richter * | If timestamp is positive the sample is entered into an ordered_event 10633d9e183SThomas Richter * | list, sort order is the timestamp. The event processing is deferred until 10733d9e183SThomas Richter * | later (see perf_session__process_user_event()). 10833d9e183SThomas Richter * | Other timestamps (0 or -1) are handled immediately by 10933d9e183SThomas Richter * | perf_session__deliver_event(). These are events generated at start up 11033d9e183SThomas Richter * | of command perf record. They create PERF_RECORD_COMM and PERF_RECORD_MMAP* 11133d9e183SThomas Richter * | records. They are needed to create a list of running processes and its 11233d9e183SThomas Richter * | memory mappings and layout. They are needed at the beginning to enable 11333d9e183SThomas Richter * | command perf report to create process trees and memory mappings. 11433d9e183SThomas Richter * | 11533d9e183SThomas Richter * perf_session__deliver_event() 11633d9e183SThomas Richter * | Delivers a PERF_RECORD_XXX entry for handling. 11733d9e183SThomas Richter * | 11833d9e183SThomas Richter * auxtrace__process_event() 11933d9e183SThomas Richter * | The timestamp of the PERF_RECORD_XXX entry is taken to correlate with 12033d9e183SThomas Richter * | time stamps from the auxiliary trace buffers. This enables 12133d9e183SThomas Richter * | synchronization between auxiliary trace data and the events on the 12233d9e183SThomas Richter * | perf.data file. 12333d9e183SThomas Richter * | 12433d9e183SThomas Richter * machine__deliver_event() 12533d9e183SThomas Richter * | Handles the PERF_RECORD_XXX event. This depends on the record type. 12633d9e183SThomas Richter * It might update the process tree, update a process memory map or enter 12733d9e183SThomas Richter * a sample with IP and call back chain data into GUI data pool. 12833d9e183SThomas Richter * 12933d9e183SThomas Richter * 13033d9e183SThomas Richter * Deferred processing determined by perf_session__process_user_event() is 13133d9e183SThomas Richter * finally processed when a PERF_RECORD_FINISHED_ROUND is encountered. These 13233d9e183SThomas Richter * are generated during command perf record. 13333d9e183SThomas Richter * The timestamp of PERF_RECORD_FINISHED_ROUND event is taken to process all 13433d9e183SThomas Richter * PERF_RECORD_XXX entries stored in the ordered_event list. This list was 13533d9e183SThomas Richter * built up while reading the perf.data file. 13633d9e183SThomas Richter * Each event is now processed by calling perf_session__deliver_event(). 13733d9e183SThomas Richter * This enables time synchronization between the data in the perf.data file and 13833d9e183SThomas Richter * the data in the auxiliary trace buffers. 139b96e6615SThomas Richter */ 140b96e6615SThomas Richter 141b96e6615SThomas Richter #include <endian.h> 142b96e6615SThomas Richter #include <errno.h> 143b96e6615SThomas Richter #include <byteswap.h> 144b96e6615SThomas Richter #include <inttypes.h> 145b96e6615SThomas Richter #include <linux/kernel.h> 146b96e6615SThomas Richter #include <linux/types.h> 147b96e6615SThomas Richter #include <linux/bitops.h> 148b96e6615SThomas Richter #include <linux/log2.h> 149b96e6615SThomas Richter 150766e0618SThomas Richter #include <sys/stat.h> 151766e0618SThomas Richter #include <sys/types.h> 152766e0618SThomas Richter 153b96e6615SThomas Richter #include "cpumap.h" 154b96e6615SThomas Richter #include "color.h" 155b96e6615SThomas Richter #include "evsel.h" 156b96e6615SThomas Richter #include "evlist.h" 157b96e6615SThomas Richter #include "machine.h" 158b96e6615SThomas Richter #include "session.h" 159b96e6615SThomas Richter #include "util.h" 160b96e6615SThomas Richter #include "thread.h" 161b96e6615SThomas Richter #include "debug.h" 162b96e6615SThomas Richter #include "auxtrace.h" 163b96e6615SThomas Richter #include "s390-cpumsf.h" 1642b1444f2SThomas Richter #include "s390-cpumsf-kernel.h" 1658dabe9c4SThomas Richter #include "s390-cpumcf-kernel.h" 166766e0618SThomas Richter #include "config.h" 167b96e6615SThomas Richter 168b96e6615SThomas Richter struct s390_cpumsf { 169b96e6615SThomas Richter struct auxtrace auxtrace; 170b96e6615SThomas Richter struct auxtrace_queues queues; 171b96e6615SThomas Richter struct auxtrace_heap heap; 172b96e6615SThomas Richter struct perf_session *session; 173b96e6615SThomas Richter struct machine *machine; 174b96e6615SThomas Richter u32 auxtrace_type; 175b96e6615SThomas Richter u32 pmu_type; 1762b1444f2SThomas Richter u16 machine_type; 17733d9e183SThomas Richter bool data_queued; 178766e0618SThomas Richter bool use_logfile; 179766e0618SThomas Richter char *logdir; 18033d9e183SThomas Richter }; 18133d9e183SThomas Richter 18233d9e183SThomas Richter struct s390_cpumsf_queue { 18333d9e183SThomas Richter struct s390_cpumsf *sf; 18433d9e183SThomas Richter unsigned int queue_nr; 18533d9e183SThomas Richter struct auxtrace_buffer *buffer; 18633d9e183SThomas Richter int cpu; 187766e0618SThomas Richter FILE *logfile; 1888dabe9c4SThomas Richter FILE *logfile_ctr; 189b96e6615SThomas Richter }; 190b96e6615SThomas Richter 1918dabe9c4SThomas Richter /* Check if the raw data should be dumped to file. If this is the case and 1928dabe9c4SThomas Richter * the file to dump to has not been opened for writing, do so. 1938dabe9c4SThomas Richter * 1948dabe9c4SThomas Richter * Return 0 on success and greater zero on error so processing continues. 1958dabe9c4SThomas Richter */ 1968dabe9c4SThomas Richter static int s390_cpumcf_dumpctr(struct s390_cpumsf *sf, 1978dabe9c4SThomas Richter struct perf_sample *sample) 1988dabe9c4SThomas Richter { 1998dabe9c4SThomas Richter struct s390_cpumsf_queue *sfq; 2008dabe9c4SThomas Richter struct auxtrace_queue *q; 2018dabe9c4SThomas Richter int rc = 0; 2028dabe9c4SThomas Richter 2038dabe9c4SThomas Richter if (!sf->use_logfile || sf->queues.nr_queues <= sample->cpu) 2048dabe9c4SThomas Richter return rc; 2058dabe9c4SThomas Richter 2068dabe9c4SThomas Richter q = &sf->queues.queue_array[sample->cpu]; 2078dabe9c4SThomas Richter sfq = q->priv; 2088dabe9c4SThomas Richter if (!sfq) /* Queue not yet allocated */ 2098dabe9c4SThomas Richter return rc; 2108dabe9c4SThomas Richter 2118dabe9c4SThomas Richter if (!sfq->logfile_ctr) { 2128dabe9c4SThomas Richter char *name; 2138dabe9c4SThomas Richter 2148dabe9c4SThomas Richter rc = (sf->logdir) 2158dabe9c4SThomas Richter ? asprintf(&name, "%s/aux.ctr.%02x", 2168dabe9c4SThomas Richter sf->logdir, sample->cpu) 2178dabe9c4SThomas Richter : asprintf(&name, "aux.ctr.%02x", sample->cpu); 2188dabe9c4SThomas Richter if (rc > 0) 2198dabe9c4SThomas Richter sfq->logfile_ctr = fopen(name, "w"); 2208dabe9c4SThomas Richter if (sfq->logfile_ctr == NULL) { 2218dabe9c4SThomas Richter pr_err("Failed to open counter set log file %s, " 2228dabe9c4SThomas Richter "continue...\n", name); 2238dabe9c4SThomas Richter rc = 1; 2248dabe9c4SThomas Richter } 2258dabe9c4SThomas Richter free(name); 2268dabe9c4SThomas Richter } 2278dabe9c4SThomas Richter 2288dabe9c4SThomas Richter if (sfq->logfile_ctr) { 2298dabe9c4SThomas Richter /* See comment above for -4 */ 2308dabe9c4SThomas Richter size_t n = fwrite(sample->raw_data, sample->raw_size - 4, 1, 2318dabe9c4SThomas Richter sfq->logfile_ctr); 2328dabe9c4SThomas Richter if (n != 1) { 2338dabe9c4SThomas Richter pr_err("Failed to write counter set data\n"); 2348dabe9c4SThomas Richter rc = 1; 2358dabe9c4SThomas Richter } 2368dabe9c4SThomas Richter } 2378dabe9c4SThomas Richter return rc; 2388dabe9c4SThomas Richter } 2398dabe9c4SThomas Richter 2402b1444f2SThomas Richter /* Display s390 CPU measurement facility basic-sampling data entry */ 2412b1444f2SThomas Richter static bool s390_cpumsf_basic_show(const char *color, size_t pos, 2422b1444f2SThomas Richter struct hws_basic_entry *basic) 2432b1444f2SThomas Richter { 2442b1444f2SThomas Richter if (basic->def != 1) { 2452b1444f2SThomas Richter pr_err("Invalid AUX trace basic entry [%#08zx]\n", pos); 2462b1444f2SThomas Richter return false; 2472b1444f2SThomas Richter } 2482b1444f2SThomas Richter color_fprintf(stdout, color, " [%#08zx] Basic Def:%04x Inst:%#04x" 2492b1444f2SThomas Richter " %c%c%c%c AS:%d ASN:%#04x IA:%#018llx\n" 2502b1444f2SThomas Richter "\t\tCL:%d HPP:%#018llx GPP:%#018llx\n", 2512b1444f2SThomas Richter pos, basic->def, basic->U, 2522b1444f2SThomas Richter basic->T ? 'T' : ' ', 2532b1444f2SThomas Richter basic->W ? 'W' : ' ', 2542b1444f2SThomas Richter basic->P ? 'P' : ' ', 2552b1444f2SThomas Richter basic->I ? 'I' : ' ', 2562b1444f2SThomas Richter basic->AS, basic->prim_asn, basic->ia, basic->CL, 2572b1444f2SThomas Richter basic->hpp, basic->gpp); 2582b1444f2SThomas Richter return true; 2592b1444f2SThomas Richter } 2602b1444f2SThomas Richter 2612b1444f2SThomas Richter /* Display s390 CPU measurement facility diagnostic-sampling data entry */ 2622b1444f2SThomas Richter static bool s390_cpumsf_diag_show(const char *color, size_t pos, 2632b1444f2SThomas Richter struct hws_diag_entry *diag) 2642b1444f2SThomas Richter { 2652b1444f2SThomas Richter if (diag->def < S390_CPUMSF_DIAG_DEF_FIRST) { 2662b1444f2SThomas Richter pr_err("Invalid AUX trace diagnostic entry [%#08zx]\n", pos); 2672b1444f2SThomas Richter return false; 2682b1444f2SThomas Richter } 2692b1444f2SThomas Richter color_fprintf(stdout, color, " [%#08zx] Diag Def:%04x %c\n", 2702b1444f2SThomas Richter pos, diag->def, diag->I ? 'I' : ' '); 2712b1444f2SThomas Richter return true; 2722b1444f2SThomas Richter } 2732b1444f2SThomas Richter 2742b1444f2SThomas Richter /* Return TOD timestamp contained in an trailer entry */ 2752b1444f2SThomas Richter static unsigned long long trailer_timestamp(struct hws_trailer_entry *te) 2762b1444f2SThomas Richter { 2772b1444f2SThomas Richter /* te->t set: TOD in STCKE format, bytes 8-15 2782b1444f2SThomas Richter * to->t not set: TOD in STCK format, bytes 0-7 2792b1444f2SThomas Richter */ 2802b1444f2SThomas Richter unsigned long long ts; 2812b1444f2SThomas Richter 2822b1444f2SThomas Richter memcpy(&ts, &te->timestamp[te->t], sizeof(ts)); 2832b1444f2SThomas Richter return ts; 2842b1444f2SThomas Richter } 2852b1444f2SThomas Richter 2862b1444f2SThomas Richter /* Display s390 CPU measurement facility trailer entry */ 2872b1444f2SThomas Richter static bool s390_cpumsf_trailer_show(const char *color, size_t pos, 2882b1444f2SThomas Richter struct hws_trailer_entry *te) 2892b1444f2SThomas Richter { 2902b1444f2SThomas Richter if (te->bsdes != sizeof(struct hws_basic_entry)) { 2912b1444f2SThomas Richter pr_err("Invalid AUX trace trailer entry [%#08zx]\n", pos); 2922b1444f2SThomas Richter return false; 2932b1444f2SThomas Richter } 2942b1444f2SThomas Richter color_fprintf(stdout, color, " [%#08zx] Trailer %c%c%c bsdes:%d" 2952b1444f2SThomas Richter " dsdes:%d Overflow:%lld Time:%#llx\n" 2962b1444f2SThomas Richter "\t\tC:%d TOD:%#lx 1:%#llx 2:%#llx\n", 2972b1444f2SThomas Richter pos, 2982b1444f2SThomas Richter te->f ? 'F' : ' ', 2992b1444f2SThomas Richter te->a ? 'A' : ' ', 3002b1444f2SThomas Richter te->t ? 'T' : ' ', 3012b1444f2SThomas Richter te->bsdes, te->dsdes, te->overflow, 3022b1444f2SThomas Richter trailer_timestamp(te), te->clock_base, te->progusage2, 3032b1444f2SThomas Richter te->progusage[0], te->progusage[1]); 3042b1444f2SThomas Richter return true; 3052b1444f2SThomas Richter } 3062b1444f2SThomas Richter 3072b1444f2SThomas Richter /* Test a sample data block. It must be 4KB or a multiple thereof in size and 3082b1444f2SThomas Richter * 4KB page aligned. Each sample data page has a trailer entry at the 3092b1444f2SThomas Richter * end which contains the sample entry data sizes. 3102b1444f2SThomas Richter * 3112b1444f2SThomas Richter * Return true if the sample data block passes the checks and set the 3122b1444f2SThomas Richter * basic set entry size and diagnostic set entry size. 3132b1444f2SThomas Richter * 3142b1444f2SThomas Richter * Return false on failure. 3152b1444f2SThomas Richter * 3162b1444f2SThomas Richter * Note: Old hardware does not set the basic or diagnostic entry sizes 3172b1444f2SThomas Richter * in the trailer entry. Use the type number instead. 3182b1444f2SThomas Richter */ 3192b1444f2SThomas Richter static bool s390_cpumsf_validate(int machine_type, 3202b1444f2SThomas Richter unsigned char *buf, size_t len, 3212b1444f2SThomas Richter unsigned short *bsdes, 3222b1444f2SThomas Richter unsigned short *dsdes) 3232b1444f2SThomas Richter { 3242b1444f2SThomas Richter struct hws_basic_entry *basic = (struct hws_basic_entry *)buf; 3252b1444f2SThomas Richter struct hws_trailer_entry *te; 3262b1444f2SThomas Richter 3272b1444f2SThomas Richter *dsdes = *bsdes = 0; 3282b1444f2SThomas Richter if (len & (S390_CPUMSF_PAGESZ - 1)) /* Illegal size */ 3292b1444f2SThomas Richter return false; 3302b1444f2SThomas Richter if (basic->def != 1) /* No basic set entry, must be first */ 3312b1444f2SThomas Richter return false; 3322b1444f2SThomas Richter /* Check for trailer entry at end of SDB */ 3332b1444f2SThomas Richter te = (struct hws_trailer_entry *)(buf + S390_CPUMSF_PAGESZ 3342b1444f2SThomas Richter - sizeof(*te)); 3352b1444f2SThomas Richter *bsdes = te->bsdes; 3362b1444f2SThomas Richter *dsdes = te->dsdes; 3372b1444f2SThomas Richter if (!te->bsdes && !te->dsdes) { 3382b1444f2SThomas Richter /* Very old hardware, use CPUID */ 3392b1444f2SThomas Richter switch (machine_type) { 3402b1444f2SThomas Richter case 2097: 3412b1444f2SThomas Richter case 2098: 3422b1444f2SThomas Richter *dsdes = 64; 3432b1444f2SThomas Richter *bsdes = 32; 3442b1444f2SThomas Richter break; 3452b1444f2SThomas Richter case 2817: 3462b1444f2SThomas Richter case 2818: 3472b1444f2SThomas Richter *dsdes = 74; 3482b1444f2SThomas Richter *bsdes = 32; 3492b1444f2SThomas Richter break; 3502b1444f2SThomas Richter case 2827: 3512b1444f2SThomas Richter case 2828: 3522b1444f2SThomas Richter *dsdes = 85; 3532b1444f2SThomas Richter *bsdes = 32; 3542b1444f2SThomas Richter break; 3552b1444f2SThomas Richter default: 3562b1444f2SThomas Richter /* Illegal trailer entry */ 3572b1444f2SThomas Richter return false; 3582b1444f2SThomas Richter } 3592b1444f2SThomas Richter } 3602b1444f2SThomas Richter return true; 3612b1444f2SThomas Richter } 3622b1444f2SThomas Richter 3632b1444f2SThomas Richter /* Return true if there is room for another entry */ 3642b1444f2SThomas Richter static bool s390_cpumsf_reached_trailer(size_t entry_sz, size_t pos) 3652b1444f2SThomas Richter { 3662b1444f2SThomas Richter size_t payload = S390_CPUMSF_PAGESZ - sizeof(struct hws_trailer_entry); 3672b1444f2SThomas Richter 3682b1444f2SThomas Richter if (payload - (pos & (S390_CPUMSF_PAGESZ - 1)) < entry_sz) 3692b1444f2SThomas Richter return false; 3702b1444f2SThomas Richter return true; 3712b1444f2SThomas Richter } 3722b1444f2SThomas Richter 3732b1444f2SThomas Richter /* Dump an auxiliary buffer. These buffers are multiple of 3742b1444f2SThomas Richter * 4KB SDB pages. 3752b1444f2SThomas Richter */ 3762b1444f2SThomas Richter static void s390_cpumsf_dump(struct s390_cpumsf *sf, 3772b1444f2SThomas Richter unsigned char *buf, size_t len) 3782b1444f2SThomas Richter { 3792b1444f2SThomas Richter const char *color = PERF_COLOR_BLUE; 3802b1444f2SThomas Richter struct hws_basic_entry *basic; 3812b1444f2SThomas Richter struct hws_diag_entry *diag; 3822b1444f2SThomas Richter unsigned short bsdes, dsdes; 38333d9e183SThomas Richter size_t pos = 0; 3842b1444f2SThomas Richter 3852b1444f2SThomas Richter color_fprintf(stdout, color, 3862b1444f2SThomas Richter ". ... s390 AUX data: size %zu bytes\n", 3872b1444f2SThomas Richter len); 3882b1444f2SThomas Richter 3892b1444f2SThomas Richter if (!s390_cpumsf_validate(sf->machine_type, buf, len, &bsdes, 3902b1444f2SThomas Richter &dsdes)) { 3912b1444f2SThomas Richter pr_err("Invalid AUX trace data block size:%zu" 3922b1444f2SThomas Richter " (type:%d bsdes:%hd dsdes:%hd)\n", 3932b1444f2SThomas Richter len, sf->machine_type, bsdes, dsdes); 3942b1444f2SThomas Richter return; 3952b1444f2SThomas Richter } 3962b1444f2SThomas Richter 3972b1444f2SThomas Richter /* s390 kernel always returns 4KB blocks fully occupied, 3982b1444f2SThomas Richter * no partially filled SDBs. 3992b1444f2SThomas Richter */ 4002b1444f2SThomas Richter while (pos < len) { 4012b1444f2SThomas Richter /* Handle Basic entry */ 4022b1444f2SThomas Richter basic = (struct hws_basic_entry *)(buf + pos); 4032b1444f2SThomas Richter if (s390_cpumsf_basic_show(color, pos, basic)) 4042b1444f2SThomas Richter pos += bsdes; 4052b1444f2SThomas Richter else 4062b1444f2SThomas Richter return; 4072b1444f2SThomas Richter 4082b1444f2SThomas Richter /* Handle Diagnostic entry */ 4092b1444f2SThomas Richter diag = (struct hws_diag_entry *)(buf + pos); 4102b1444f2SThomas Richter if (s390_cpumsf_diag_show(color, pos, diag)) 4112b1444f2SThomas Richter pos += dsdes; 4122b1444f2SThomas Richter else 4132b1444f2SThomas Richter return; 4142b1444f2SThomas Richter 4152b1444f2SThomas Richter /* Check for trailer entry */ 4162b1444f2SThomas Richter if (!s390_cpumsf_reached_trailer(bsdes + dsdes, pos)) { 4172b1444f2SThomas Richter /* Show trailer entry */ 4182b1444f2SThomas Richter struct hws_trailer_entry te; 4192b1444f2SThomas Richter 4202b1444f2SThomas Richter pos = (pos + S390_CPUMSF_PAGESZ) 4212b1444f2SThomas Richter & ~(S390_CPUMSF_PAGESZ - 1); 4222b1444f2SThomas Richter pos -= sizeof(te); 4232b1444f2SThomas Richter memcpy(&te, buf + pos, sizeof(te)); 4242b1444f2SThomas Richter /* Set descriptor sizes in case of old hardware 4252b1444f2SThomas Richter * where these values are not set. 4262b1444f2SThomas Richter */ 4272b1444f2SThomas Richter te.bsdes = bsdes; 4282b1444f2SThomas Richter te.dsdes = dsdes; 4292b1444f2SThomas Richter if (s390_cpumsf_trailer_show(color, pos, &te)) 4302b1444f2SThomas Richter pos += sizeof(te); 4312b1444f2SThomas Richter else 4322b1444f2SThomas Richter return; 4332b1444f2SThomas Richter } 4342b1444f2SThomas Richter } 4352b1444f2SThomas Richter } 4362b1444f2SThomas Richter 4372b1444f2SThomas Richter static void s390_cpumsf_dump_event(struct s390_cpumsf *sf, unsigned char *buf, 4382b1444f2SThomas Richter size_t len) 4392b1444f2SThomas Richter { 4402b1444f2SThomas Richter printf(".\n"); 4412b1444f2SThomas Richter s390_cpumsf_dump(sf, buf, len); 4422b1444f2SThomas Richter } 4432b1444f2SThomas Richter 44433d9e183SThomas Richter #define S390_LPP_PID_MASK 0xffffffff 44533d9e183SThomas Richter 44633d9e183SThomas Richter static bool s390_cpumsf_make_event(size_t pos, 44733d9e183SThomas Richter struct hws_basic_entry *basic, 44833d9e183SThomas Richter struct s390_cpumsf_queue *sfq) 449b96e6615SThomas Richter { 45033d9e183SThomas Richter struct perf_sample sample = { 45133d9e183SThomas Richter .ip = basic->ia, 45233d9e183SThomas Richter .pid = basic->hpp & S390_LPP_PID_MASK, 45333d9e183SThomas Richter .tid = basic->hpp & S390_LPP_PID_MASK, 45433d9e183SThomas Richter .cpumode = PERF_RECORD_MISC_CPUMODE_UNKNOWN, 45533d9e183SThomas Richter .cpu = sfq->cpu, 45633d9e183SThomas Richter .period = 1 45733d9e183SThomas Richter }; 45833d9e183SThomas Richter union perf_event event; 45933d9e183SThomas Richter 46033d9e183SThomas Richter memset(&event, 0, sizeof(event)); 46133d9e183SThomas Richter if (basic->CL == 1) /* Native LPAR mode */ 46233d9e183SThomas Richter sample.cpumode = basic->P ? PERF_RECORD_MISC_USER 46333d9e183SThomas Richter : PERF_RECORD_MISC_KERNEL; 46433d9e183SThomas Richter else if (basic->CL == 2) /* Guest kernel/user space */ 46533d9e183SThomas Richter sample.cpumode = basic->P ? PERF_RECORD_MISC_GUEST_USER 46633d9e183SThomas Richter : PERF_RECORD_MISC_GUEST_KERNEL; 46733d9e183SThomas Richter else if (basic->gpp || basic->prim_asn != 0xffff) 46833d9e183SThomas Richter /* Use heuristics on old hardware */ 46933d9e183SThomas Richter sample.cpumode = basic->P ? PERF_RECORD_MISC_GUEST_USER 47033d9e183SThomas Richter : PERF_RECORD_MISC_GUEST_KERNEL; 47133d9e183SThomas Richter else 47233d9e183SThomas Richter sample.cpumode = basic->P ? PERF_RECORD_MISC_USER 47333d9e183SThomas Richter : PERF_RECORD_MISC_KERNEL; 47433d9e183SThomas Richter 47533d9e183SThomas Richter event.sample.header.type = PERF_RECORD_SAMPLE; 47633d9e183SThomas Richter event.sample.header.misc = sample.cpumode; 47733d9e183SThomas Richter event.sample.header.size = sizeof(struct perf_event_header); 47833d9e183SThomas Richter 47933d9e183SThomas Richter pr_debug4("%s pos:%#zx ip:%#" PRIx64 " P:%d CL:%d pid:%d.%d cpumode:%d cpu:%d\n", 48033d9e183SThomas Richter __func__, pos, sample.ip, basic->P, basic->CL, sample.pid, 48133d9e183SThomas Richter sample.tid, sample.cpumode, sample.cpu); 48233d9e183SThomas Richter if (perf_session__deliver_synth_event(sfq->sf->session, &event, 48333d9e183SThomas Richter &sample)) { 48433d9e183SThomas Richter pr_err("s390 Auxiliary Trace: failed to deliver event\n"); 48533d9e183SThomas Richter return false; 48633d9e183SThomas Richter } 48733d9e183SThomas Richter return true; 48833d9e183SThomas Richter } 48933d9e183SThomas Richter 49033d9e183SThomas Richter static unsigned long long get_trailer_time(const unsigned char *buf) 49133d9e183SThomas Richter { 49233d9e183SThomas Richter struct hws_trailer_entry *te; 49333d9e183SThomas Richter unsigned long long aux_time; 49433d9e183SThomas Richter 49533d9e183SThomas Richter te = (struct hws_trailer_entry *)(buf + S390_CPUMSF_PAGESZ 49633d9e183SThomas Richter - sizeof(*te)); 49733d9e183SThomas Richter 49833d9e183SThomas Richter if (!te->clock_base) /* TOD_CLOCK_BASE value missing */ 49933d9e183SThomas Richter return 0; 50033d9e183SThomas Richter 50133d9e183SThomas Richter /* Correct calculation to convert time stamp in trailer entry to 50233d9e183SThomas Richter * nano seconds (taken from arch/s390 function tod_to_ns()). 50333d9e183SThomas Richter * TOD_CLOCK_BASE is stored in trailer entry member progusage2. 50433d9e183SThomas Richter */ 50533d9e183SThomas Richter aux_time = trailer_timestamp(te) - te->progusage2; 50633d9e183SThomas Richter aux_time = (aux_time >> 9) * 125 + (((aux_time & 0x1ff) * 125) >> 9); 50733d9e183SThomas Richter return aux_time; 50833d9e183SThomas Richter } 50933d9e183SThomas Richter 51033d9e183SThomas Richter /* Process the data samples of a single queue. The first parameter is a 51133d9e183SThomas Richter * pointer to the queue, the second parameter is the time stamp. This 51233d9e183SThomas Richter * is the time stamp: 51333d9e183SThomas Richter * - of the event that triggered this processing. 51433d9e183SThomas Richter * - or the time stamp when the last proccesing of this queue stopped. 51533d9e183SThomas Richter * In this case it stopped at a 4KB page boundary and record the 51633d9e183SThomas Richter * position on where to continue processing on the next invocation 51733d9e183SThomas Richter * (see buffer->use_data and buffer->use_size). 51833d9e183SThomas Richter * 51933d9e183SThomas Richter * When this function returns the second parameter is updated to 52033d9e183SThomas Richter * reflect the time stamp of the last processed auxiliary data entry 52133d9e183SThomas Richter * (taken from the trailer entry of that page). The caller uses this 52233d9e183SThomas Richter * returned time stamp to record the last processed entry in this 52333d9e183SThomas Richter * queue. 52433d9e183SThomas Richter * 52533d9e183SThomas Richter * The function returns: 52633d9e183SThomas Richter * 0: Processing successful. The second parameter returns the 52733d9e183SThomas Richter * time stamp from the trailer entry until which position 52833d9e183SThomas Richter * processing took place. Subsequent calls resume from this 52933d9e183SThomas Richter * position. 53033d9e183SThomas Richter * <0: An error occurred during processing. The second parameter 53133d9e183SThomas Richter * returns the maximum time stamp. 53233d9e183SThomas Richter * >0: Done on this queue. The second parameter returns the 53333d9e183SThomas Richter * maximum time stamp. 53433d9e183SThomas Richter */ 53533d9e183SThomas Richter static int s390_cpumsf_samples(struct s390_cpumsf_queue *sfq, u64 *ts) 53633d9e183SThomas Richter { 53733d9e183SThomas Richter struct s390_cpumsf *sf = sfq->sf; 53833d9e183SThomas Richter unsigned char *buf = sfq->buffer->use_data; 53933d9e183SThomas Richter size_t len = sfq->buffer->use_size; 54033d9e183SThomas Richter struct hws_basic_entry *basic; 54133d9e183SThomas Richter unsigned short bsdes, dsdes; 54233d9e183SThomas Richter size_t pos = 0; 54333d9e183SThomas Richter int err = 1; 54433d9e183SThomas Richter u64 aux_ts; 54533d9e183SThomas Richter 54633d9e183SThomas Richter if (!s390_cpumsf_validate(sf->machine_type, buf, len, &bsdes, 54733d9e183SThomas Richter &dsdes)) { 54833d9e183SThomas Richter *ts = ~0ULL; 54933d9e183SThomas Richter return -1; 55033d9e183SThomas Richter } 55133d9e183SThomas Richter 55233d9e183SThomas Richter /* Get trailer entry time stamp and check if entries in 55333d9e183SThomas Richter * this auxiliary page are ready for processing. If the 55433d9e183SThomas Richter * time stamp of the first entry is too high, whole buffer 55533d9e183SThomas Richter * can be skipped. In this case return time stamp. 55633d9e183SThomas Richter */ 55733d9e183SThomas Richter aux_ts = get_trailer_time(buf); 55833d9e183SThomas Richter if (!aux_ts) { 55933d9e183SThomas Richter pr_err("[%#08" PRIx64 "] Invalid AUX trailer entry TOD clock base\n", 560866053bbSArnaldo Carvalho de Melo (s64)sfq->buffer->data_offset); 56133d9e183SThomas Richter aux_ts = ~0ULL; 56233d9e183SThomas Richter goto out; 56333d9e183SThomas Richter } 56433d9e183SThomas Richter if (aux_ts > *ts) { 56533d9e183SThomas Richter *ts = aux_ts; 566b96e6615SThomas Richter return 0; 567b96e6615SThomas Richter } 568b96e6615SThomas Richter 56933d9e183SThomas Richter while (pos < len) { 57033d9e183SThomas Richter /* Handle Basic entry */ 57133d9e183SThomas Richter basic = (struct hws_basic_entry *)(buf + pos); 57233d9e183SThomas Richter if (s390_cpumsf_make_event(pos, basic, sfq)) 57333d9e183SThomas Richter pos += bsdes; 57433d9e183SThomas Richter else { 57533d9e183SThomas Richter err = -EBADF; 57633d9e183SThomas Richter goto out; 57733d9e183SThomas Richter } 57833d9e183SThomas Richter 57933d9e183SThomas Richter pos += dsdes; /* Skip diagnositic entry */ 58033d9e183SThomas Richter 58133d9e183SThomas Richter /* Check for trailer entry */ 58233d9e183SThomas Richter if (!s390_cpumsf_reached_trailer(bsdes + dsdes, pos)) { 58333d9e183SThomas Richter pos = (pos + S390_CPUMSF_PAGESZ) 58433d9e183SThomas Richter & ~(S390_CPUMSF_PAGESZ - 1); 58533d9e183SThomas Richter /* Check existence of next page */ 58633d9e183SThomas Richter if (pos >= len) 58733d9e183SThomas Richter break; 58833d9e183SThomas Richter aux_ts = get_trailer_time(buf + pos); 58933d9e183SThomas Richter if (!aux_ts) { 59033d9e183SThomas Richter aux_ts = ~0ULL; 59133d9e183SThomas Richter goto out; 59233d9e183SThomas Richter } 59333d9e183SThomas Richter if (aux_ts > *ts) { 59433d9e183SThomas Richter *ts = aux_ts; 59533d9e183SThomas Richter sfq->buffer->use_data += pos; 59633d9e183SThomas Richter sfq->buffer->use_size -= pos; 59733d9e183SThomas Richter return 0; 59833d9e183SThomas Richter } 59933d9e183SThomas Richter } 60033d9e183SThomas Richter } 60133d9e183SThomas Richter out: 60233d9e183SThomas Richter *ts = aux_ts; 60333d9e183SThomas Richter sfq->buffer->use_size = 0; 60433d9e183SThomas Richter sfq->buffer->use_data = NULL; 60533d9e183SThomas Richter return err; /* Buffer completely scanned or error */ 60633d9e183SThomas Richter } 60733d9e183SThomas Richter 60833d9e183SThomas Richter /* Run the s390 auxiliary trace decoder. 60933d9e183SThomas Richter * Select the queue buffer to operate on, the caller already selected 61033d9e183SThomas Richter * the proper queue, depending on second parameter 'ts'. 61133d9e183SThomas Richter * This is the time stamp until which the auxiliary entries should 61233d9e183SThomas Richter * be processed. This value is updated by called functions and 61333d9e183SThomas Richter * returned to the caller. 61433d9e183SThomas Richter * 61533d9e183SThomas Richter * Resume processing in the current buffer. If there is no buffer 61633d9e183SThomas Richter * get a new buffer from the queue and setup start position for 61733d9e183SThomas Richter * processing. 61833d9e183SThomas Richter * When a buffer is completely processed remove it from the queue 61933d9e183SThomas Richter * before returning. 62033d9e183SThomas Richter * 62133d9e183SThomas Richter * This function returns 62233d9e183SThomas Richter * 1: When the queue is empty. Second parameter will be set to 62333d9e183SThomas Richter * maximum time stamp. 62433d9e183SThomas Richter * 0: Normal processing done. 62533d9e183SThomas Richter * <0: Error during queue buffer setup. This causes the caller 62633d9e183SThomas Richter * to stop processing completely. 62733d9e183SThomas Richter */ 62833d9e183SThomas Richter static int s390_cpumsf_run_decoder(struct s390_cpumsf_queue *sfq, 62933d9e183SThomas Richter u64 *ts) 63033d9e183SThomas Richter { 63133d9e183SThomas Richter 63233d9e183SThomas Richter struct auxtrace_buffer *buffer; 63333d9e183SThomas Richter struct auxtrace_queue *queue; 63433d9e183SThomas Richter int err; 63533d9e183SThomas Richter 63633d9e183SThomas Richter queue = &sfq->sf->queues.queue_array[sfq->queue_nr]; 63733d9e183SThomas Richter 63833d9e183SThomas Richter /* Get buffer and last position in buffer to resume 63933d9e183SThomas Richter * decoding the auxiliary entries. One buffer might be large 64033d9e183SThomas Richter * and decoding might stop in between. This depends on the time 64133d9e183SThomas Richter * stamp of the trailer entry in each page of the auxiliary 64233d9e183SThomas Richter * data and the time stamp of the event triggering the decoding. 64333d9e183SThomas Richter */ 64433d9e183SThomas Richter if (sfq->buffer == NULL) { 64533d9e183SThomas Richter sfq->buffer = buffer = auxtrace_buffer__next(queue, 64633d9e183SThomas Richter sfq->buffer); 64733d9e183SThomas Richter if (!buffer) { 64833d9e183SThomas Richter *ts = ~0ULL; 64933d9e183SThomas Richter return 1; /* Processing done on this queue */ 65033d9e183SThomas Richter } 65133d9e183SThomas Richter /* Start with a new buffer on this queue */ 65233d9e183SThomas Richter if (buffer->data) { 65333d9e183SThomas Richter buffer->use_size = buffer->size; 65433d9e183SThomas Richter buffer->use_data = buffer->data; 65533d9e183SThomas Richter } 656766e0618SThomas Richter if (sfq->logfile) { /* Write into log file */ 657766e0618SThomas Richter size_t rc = fwrite(buffer->data, buffer->size, 1, 658766e0618SThomas Richter sfq->logfile); 659766e0618SThomas Richter if (rc != 1) 660766e0618SThomas Richter pr_err("Failed to write auxiliary data\n"); 661766e0618SThomas Richter } 66233d9e183SThomas Richter } else 66333d9e183SThomas Richter buffer = sfq->buffer; 66433d9e183SThomas Richter 66533d9e183SThomas Richter if (!buffer->data) { 66633d9e183SThomas Richter int fd = perf_data__fd(sfq->sf->session->data); 66733d9e183SThomas Richter 66833d9e183SThomas Richter buffer->data = auxtrace_buffer__get_data(buffer, fd); 66933d9e183SThomas Richter if (!buffer->data) 67033d9e183SThomas Richter return -ENOMEM; 67133d9e183SThomas Richter buffer->use_size = buffer->size; 67233d9e183SThomas Richter buffer->use_data = buffer->data; 673766e0618SThomas Richter 674766e0618SThomas Richter if (sfq->logfile) { /* Write into log file */ 675766e0618SThomas Richter size_t rc = fwrite(buffer->data, buffer->size, 1, 676766e0618SThomas Richter sfq->logfile); 677766e0618SThomas Richter if (rc != 1) 678766e0618SThomas Richter pr_err("Failed to write auxiliary data\n"); 679766e0618SThomas Richter } 68033d9e183SThomas Richter } 68133d9e183SThomas Richter pr_debug4("%s queue_nr:%d buffer:%" PRId64 " offset:%#" PRIx64 " size:%#zx rest:%#zx\n", 68233d9e183SThomas Richter __func__, sfq->queue_nr, buffer->buffer_nr, buffer->offset, 68333d9e183SThomas Richter buffer->size, buffer->use_size); 68433d9e183SThomas Richter err = s390_cpumsf_samples(sfq, ts); 68533d9e183SThomas Richter 68633d9e183SThomas Richter /* If non-zero, there is either an error (err < 0) or the buffer is 68733d9e183SThomas Richter * completely done (err > 0). The error is unrecoverable, usually 68833d9e183SThomas Richter * some descriptors could not be read successfully, so continue with 68933d9e183SThomas Richter * the next buffer. 69033d9e183SThomas Richter * In both cases the parameter 'ts' has been updated. 69133d9e183SThomas Richter */ 69233d9e183SThomas Richter if (err) { 69333d9e183SThomas Richter sfq->buffer = NULL; 69433d9e183SThomas Richter list_del(&buffer->list); 69533d9e183SThomas Richter auxtrace_buffer__free(buffer); 69633d9e183SThomas Richter if (err > 0) /* Buffer done, no error */ 69733d9e183SThomas Richter err = 0; 69833d9e183SThomas Richter } 69933d9e183SThomas Richter return err; 70033d9e183SThomas Richter } 70133d9e183SThomas Richter 70233d9e183SThomas Richter static struct s390_cpumsf_queue * 70333d9e183SThomas Richter s390_cpumsf_alloc_queue(struct s390_cpumsf *sf, unsigned int queue_nr) 70433d9e183SThomas Richter { 70533d9e183SThomas Richter struct s390_cpumsf_queue *sfq; 70633d9e183SThomas Richter 70733d9e183SThomas Richter sfq = zalloc(sizeof(struct s390_cpumsf_queue)); 70833d9e183SThomas Richter if (sfq == NULL) 70933d9e183SThomas Richter return NULL; 71033d9e183SThomas Richter 71133d9e183SThomas Richter sfq->sf = sf; 71233d9e183SThomas Richter sfq->queue_nr = queue_nr; 71333d9e183SThomas Richter sfq->cpu = -1; 714766e0618SThomas Richter if (sf->use_logfile) { 715766e0618SThomas Richter char *name; 716766e0618SThomas Richter int rc; 717766e0618SThomas Richter 718766e0618SThomas Richter rc = (sf->logdir) 719766e0618SThomas Richter ? asprintf(&name, "%s/aux.smp.%02x", 720766e0618SThomas Richter sf->logdir, queue_nr) 721766e0618SThomas Richter : asprintf(&name, "aux.smp.%02x", queue_nr); 722766e0618SThomas Richter if (rc > 0) 723766e0618SThomas Richter sfq->logfile = fopen(name, "w"); 724766e0618SThomas Richter if (sfq->logfile == NULL) { 725766e0618SThomas Richter pr_err("Failed to open auxiliary log file %s," 726766e0618SThomas Richter "continue...\n", name); 727766e0618SThomas Richter sf->use_logfile = false; 728766e0618SThomas Richter } 729766e0618SThomas Richter free(name); 730766e0618SThomas Richter } 73133d9e183SThomas Richter return sfq; 73233d9e183SThomas Richter } 73333d9e183SThomas Richter 73433d9e183SThomas Richter static int s390_cpumsf_setup_queue(struct s390_cpumsf *sf, 73533d9e183SThomas Richter struct auxtrace_queue *queue, 73633d9e183SThomas Richter unsigned int queue_nr, u64 ts) 73733d9e183SThomas Richter { 73833d9e183SThomas Richter struct s390_cpumsf_queue *sfq = queue->priv; 73933d9e183SThomas Richter 74033d9e183SThomas Richter if (list_empty(&queue->head)) 74133d9e183SThomas Richter return 0; 74233d9e183SThomas Richter 74333d9e183SThomas Richter if (sfq == NULL) { 74433d9e183SThomas Richter sfq = s390_cpumsf_alloc_queue(sf, queue_nr); 74533d9e183SThomas Richter if (!sfq) 74633d9e183SThomas Richter return -ENOMEM; 74733d9e183SThomas Richter queue->priv = sfq; 74833d9e183SThomas Richter 74933d9e183SThomas Richter if (queue->cpu != -1) 75033d9e183SThomas Richter sfq->cpu = queue->cpu; 75133d9e183SThomas Richter } 75233d9e183SThomas Richter return auxtrace_heap__add(&sf->heap, queue_nr, ts); 75333d9e183SThomas Richter } 75433d9e183SThomas Richter 75533d9e183SThomas Richter static int s390_cpumsf_setup_queues(struct s390_cpumsf *sf, u64 ts) 75633d9e183SThomas Richter { 75733d9e183SThomas Richter unsigned int i; 75833d9e183SThomas Richter int ret = 0; 75933d9e183SThomas Richter 76033d9e183SThomas Richter for (i = 0; i < sf->queues.nr_queues; i++) { 76133d9e183SThomas Richter ret = s390_cpumsf_setup_queue(sf, &sf->queues.queue_array[i], 76233d9e183SThomas Richter i, ts); 76333d9e183SThomas Richter if (ret) 76433d9e183SThomas Richter break; 76533d9e183SThomas Richter } 76633d9e183SThomas Richter return ret; 76733d9e183SThomas Richter } 76833d9e183SThomas Richter 76933d9e183SThomas Richter static int s390_cpumsf_update_queues(struct s390_cpumsf *sf, u64 ts) 77033d9e183SThomas Richter { 77133d9e183SThomas Richter if (!sf->queues.new_data) 77233d9e183SThomas Richter return 0; 77333d9e183SThomas Richter 77433d9e183SThomas Richter sf->queues.new_data = false; 77533d9e183SThomas Richter return s390_cpumsf_setup_queues(sf, ts); 77633d9e183SThomas Richter } 77733d9e183SThomas Richter 77833d9e183SThomas Richter static int s390_cpumsf_process_queues(struct s390_cpumsf *sf, u64 timestamp) 77933d9e183SThomas Richter { 78033d9e183SThomas Richter unsigned int queue_nr; 78133d9e183SThomas Richter u64 ts; 78233d9e183SThomas Richter int ret; 78333d9e183SThomas Richter 78433d9e183SThomas Richter while (1) { 78533d9e183SThomas Richter struct auxtrace_queue *queue; 78633d9e183SThomas Richter struct s390_cpumsf_queue *sfq; 78733d9e183SThomas Richter 78833d9e183SThomas Richter if (!sf->heap.heap_cnt) 78933d9e183SThomas Richter return 0; 79033d9e183SThomas Richter 79133d9e183SThomas Richter if (sf->heap.heap_array[0].ordinal >= timestamp) 79233d9e183SThomas Richter return 0; 79333d9e183SThomas Richter 79433d9e183SThomas Richter queue_nr = sf->heap.heap_array[0].queue_nr; 79533d9e183SThomas Richter queue = &sf->queues.queue_array[queue_nr]; 79633d9e183SThomas Richter sfq = queue->priv; 79733d9e183SThomas Richter 79833d9e183SThomas Richter auxtrace_heap__pop(&sf->heap); 79933d9e183SThomas Richter if (sf->heap.heap_cnt) { 80033d9e183SThomas Richter ts = sf->heap.heap_array[0].ordinal + 1; 80133d9e183SThomas Richter if (ts > timestamp) 80233d9e183SThomas Richter ts = timestamp; 80333d9e183SThomas Richter } else { 80433d9e183SThomas Richter ts = timestamp; 80533d9e183SThomas Richter } 80633d9e183SThomas Richter 80733d9e183SThomas Richter ret = s390_cpumsf_run_decoder(sfq, &ts); 80833d9e183SThomas Richter if (ret < 0) { 80933d9e183SThomas Richter auxtrace_heap__add(&sf->heap, queue_nr, ts); 81033d9e183SThomas Richter return ret; 81133d9e183SThomas Richter } 81233d9e183SThomas Richter if (!ret) { 81333d9e183SThomas Richter ret = auxtrace_heap__add(&sf->heap, queue_nr, ts); 81433d9e183SThomas Richter if (ret < 0) 81533d9e183SThomas Richter return ret; 81633d9e183SThomas Richter } 81733d9e183SThomas Richter } 81833d9e183SThomas Richter return 0; 81933d9e183SThomas Richter } 82033d9e183SThomas Richter 82133d9e183SThomas Richter static int s390_cpumsf_synth_error(struct s390_cpumsf *sf, int code, int cpu, 82216bd4321SAdrian Hunter pid_t pid, pid_t tid, u64 ip, u64 timestamp) 82333d9e183SThomas Richter { 82433d9e183SThomas Richter char msg[MAX_AUXTRACE_ERROR_MSG]; 82533d9e183SThomas Richter union perf_event event; 82633d9e183SThomas Richter int err; 82733d9e183SThomas Richter 82833d9e183SThomas Richter strncpy(msg, "Lost Auxiliary Trace Buffer", sizeof(msg) - 1); 82933d9e183SThomas Richter auxtrace_synth_error(&event.auxtrace_error, PERF_AUXTRACE_ERROR_ITRACE, 83016bd4321SAdrian Hunter code, cpu, pid, tid, ip, msg, timestamp); 83133d9e183SThomas Richter 83233d9e183SThomas Richter err = perf_session__deliver_synth_event(sf->session, &event, NULL); 83333d9e183SThomas Richter if (err) 83433d9e183SThomas Richter pr_err("s390 Auxiliary Trace: failed to deliver error event," 83533d9e183SThomas Richter "error %d\n", err); 83633d9e183SThomas Richter return err; 83733d9e183SThomas Richter } 83833d9e183SThomas Richter 83933d9e183SThomas Richter static int s390_cpumsf_lost(struct s390_cpumsf *sf, struct perf_sample *sample) 84033d9e183SThomas Richter { 84133d9e183SThomas Richter return s390_cpumsf_synth_error(sf, 1, sample->cpu, 84216bd4321SAdrian Hunter sample->pid, sample->tid, 0, 84316bd4321SAdrian Hunter sample->time); 84433d9e183SThomas Richter } 84533d9e183SThomas Richter 84633d9e183SThomas Richter static int 8478dabe9c4SThomas Richter s390_cpumsf_process_event(struct perf_session *session, 84833d9e183SThomas Richter union perf_event *event, 84933d9e183SThomas Richter struct perf_sample *sample, 85033d9e183SThomas Richter struct perf_tool *tool) 85133d9e183SThomas Richter { 85233d9e183SThomas Richter struct s390_cpumsf *sf = container_of(session->auxtrace, 85333d9e183SThomas Richter struct s390_cpumsf, 85433d9e183SThomas Richter auxtrace); 85533d9e183SThomas Richter u64 timestamp = sample->time; 8568dabe9c4SThomas Richter struct perf_evsel *ev_bc000; 8578dabe9c4SThomas Richter 85833d9e183SThomas Richter int err = 0; 85933d9e183SThomas Richter 86033d9e183SThomas Richter if (dump_trace) 86133d9e183SThomas Richter return 0; 86233d9e183SThomas Richter 86333d9e183SThomas Richter if (!tool->ordered_events) { 86433d9e183SThomas Richter pr_err("s390 Auxiliary Trace requires ordered events\n"); 86533d9e183SThomas Richter return -EINVAL; 86633d9e183SThomas Richter } 86733d9e183SThomas Richter 8688dabe9c4SThomas Richter if (event->header.type == PERF_RECORD_SAMPLE && 8698dabe9c4SThomas Richter sample->raw_size) { 8708dabe9c4SThomas Richter /* Handle event with raw data */ 8718dabe9c4SThomas Richter ev_bc000 = perf_evlist__event2evsel(session->evlist, event); 8728dabe9c4SThomas Richter if (ev_bc000 && 8738dabe9c4SThomas Richter ev_bc000->attr.config == PERF_EVENT_CPUM_CF_DIAG) 8748dabe9c4SThomas Richter err = s390_cpumcf_dumpctr(sf, sample); 8758dabe9c4SThomas Richter return err; 8768dabe9c4SThomas Richter } 8778dabe9c4SThomas Richter 87833d9e183SThomas Richter if (event->header.type == PERF_RECORD_AUX && 87933d9e183SThomas Richter event->aux.flags & PERF_AUX_FLAG_TRUNCATED) 88033d9e183SThomas Richter return s390_cpumsf_lost(sf, sample); 88133d9e183SThomas Richter 88233d9e183SThomas Richter if (timestamp) { 88333d9e183SThomas Richter err = s390_cpumsf_update_queues(sf, timestamp); 88433d9e183SThomas Richter if (!err) 88533d9e183SThomas Richter err = s390_cpumsf_process_queues(sf, timestamp); 88633d9e183SThomas Richter } 88733d9e183SThomas Richter return err; 88833d9e183SThomas Richter } 88933d9e183SThomas Richter 89033d9e183SThomas Richter struct s390_cpumsf_synth { 89133d9e183SThomas Richter struct perf_tool cpumsf_tool; 89233d9e183SThomas Richter struct perf_session *session; 89333d9e183SThomas Richter }; 89433d9e183SThomas Richter 895b96e6615SThomas Richter static int 8962b1444f2SThomas Richter s390_cpumsf_process_auxtrace_event(struct perf_session *session, 897b96e6615SThomas Richter union perf_event *event __maybe_unused, 898b96e6615SThomas Richter struct perf_tool *tool __maybe_unused) 899b96e6615SThomas Richter { 9002b1444f2SThomas Richter struct s390_cpumsf *sf = container_of(session->auxtrace, 9012b1444f2SThomas Richter struct s390_cpumsf, 9022b1444f2SThomas Richter auxtrace); 9032b1444f2SThomas Richter 9042b1444f2SThomas Richter int fd = perf_data__fd(session->data); 9052b1444f2SThomas Richter struct auxtrace_buffer *buffer; 9062b1444f2SThomas Richter off_t data_offset; 9072b1444f2SThomas Richter int err; 9082b1444f2SThomas Richter 90933d9e183SThomas Richter if (sf->data_queued) 91033d9e183SThomas Richter return 0; 91133d9e183SThomas Richter 9122b1444f2SThomas Richter if (perf_data__is_pipe(session->data)) { 9132b1444f2SThomas Richter data_offset = 0; 9142b1444f2SThomas Richter } else { 9152b1444f2SThomas Richter data_offset = lseek(fd, 0, SEEK_CUR); 9162b1444f2SThomas Richter if (data_offset == -1) 9172b1444f2SThomas Richter return -errno; 9182b1444f2SThomas Richter } 9192b1444f2SThomas Richter 9202b1444f2SThomas Richter err = auxtrace_queues__add_event(&sf->queues, session, event, 9212b1444f2SThomas Richter data_offset, &buffer); 9222b1444f2SThomas Richter if (err) 9232b1444f2SThomas Richter return err; 9242b1444f2SThomas Richter 9252b1444f2SThomas Richter /* Dump here after copying piped trace out of the pipe */ 9262b1444f2SThomas Richter if (dump_trace) { 9272b1444f2SThomas Richter if (auxtrace_buffer__get_data(buffer, fd)) { 9282b1444f2SThomas Richter s390_cpumsf_dump_event(sf, buffer->data, 9292b1444f2SThomas Richter buffer->size); 9302b1444f2SThomas Richter auxtrace_buffer__put_data(buffer); 9312b1444f2SThomas Richter } 9322b1444f2SThomas Richter } 933b96e6615SThomas Richter return 0; 934b96e6615SThomas Richter } 935b96e6615SThomas Richter 93633d9e183SThomas Richter static void s390_cpumsf_free_events(struct perf_session *session __maybe_unused) 93733d9e183SThomas Richter { 93833d9e183SThomas Richter } 93933d9e183SThomas Richter 940b96e6615SThomas Richter static int s390_cpumsf_flush(struct perf_session *session __maybe_unused, 941b96e6615SThomas Richter struct perf_tool *tool __maybe_unused) 942b96e6615SThomas Richter { 943b96e6615SThomas Richter return 0; 944b96e6615SThomas Richter } 945b96e6615SThomas Richter 94633d9e183SThomas Richter static void s390_cpumsf_free_queues(struct perf_session *session) 947b96e6615SThomas Richter { 948b96e6615SThomas Richter struct s390_cpumsf *sf = container_of(session->auxtrace, 949b96e6615SThomas Richter struct s390_cpumsf, 950b96e6615SThomas Richter auxtrace); 951b96e6615SThomas Richter struct auxtrace_queues *queues = &sf->queues; 952b96e6615SThomas Richter unsigned int i; 953b96e6615SThomas Richter 954766e0618SThomas Richter for (i = 0; i < queues->nr_queues; i++) { 955766e0618SThomas Richter struct s390_cpumsf_queue *sfq = (struct s390_cpumsf_queue *) 956766e0618SThomas Richter queues->queue_array[i].priv; 957766e0618SThomas Richter 9588dabe9c4SThomas Richter if (sfq != NULL) { 9598dabe9c4SThomas Richter if (sfq->logfile) { 960766e0618SThomas Richter fclose(sfq->logfile); 961766e0618SThomas Richter sfq->logfile = NULL; 962766e0618SThomas Richter } 9638dabe9c4SThomas Richter if (sfq->logfile_ctr) { 9648dabe9c4SThomas Richter fclose(sfq->logfile_ctr); 9658dabe9c4SThomas Richter sfq->logfile_ctr = NULL; 9668dabe9c4SThomas Richter } 9678dabe9c4SThomas Richter } 968b96e6615SThomas Richter zfree(&queues->queue_array[i].priv); 969766e0618SThomas Richter } 970b96e6615SThomas Richter auxtrace_queues__free(queues); 971b96e6615SThomas Richter } 972b96e6615SThomas Richter 973b96e6615SThomas Richter static void s390_cpumsf_free(struct perf_session *session) 974b96e6615SThomas Richter { 975b96e6615SThomas Richter struct s390_cpumsf *sf = container_of(session->auxtrace, 976b96e6615SThomas Richter struct s390_cpumsf, 977b96e6615SThomas Richter auxtrace); 978b96e6615SThomas Richter 979b96e6615SThomas Richter auxtrace_heap__free(&sf->heap); 98033d9e183SThomas Richter s390_cpumsf_free_queues(session); 981b96e6615SThomas Richter session->auxtrace = NULL; 982766e0618SThomas Richter free(sf->logdir); 983b96e6615SThomas Richter free(sf); 984b96e6615SThomas Richter } 985b96e6615SThomas Richter 9862b1444f2SThomas Richter static int s390_cpumsf_get_type(const char *cpuid) 9872b1444f2SThomas Richter { 9882b1444f2SThomas Richter int ret, family = 0; 9892b1444f2SThomas Richter 9902b1444f2SThomas Richter ret = sscanf(cpuid, "%*[^,],%u", &family); 9912b1444f2SThomas Richter return (ret == 1) ? family : 0; 9922b1444f2SThomas Richter } 9932b1444f2SThomas Richter 99433d9e183SThomas Richter /* Check itrace options set on perf report command. 99533d9e183SThomas Richter * Return true, if none are set or all options specified can be 996766e0618SThomas Richter * handled on s390 (currently only option 'd' for logging. 99733d9e183SThomas Richter * Return false otherwise. 99833d9e183SThomas Richter */ 99933d9e183SThomas Richter static bool check_auxtrace_itrace(struct itrace_synth_opts *itops) 100033d9e183SThomas Richter { 1001766e0618SThomas Richter bool ison = false; 1002766e0618SThomas Richter 100333d9e183SThomas Richter if (!itops || !itops->set) 100433d9e183SThomas Richter return true; 1005766e0618SThomas Richter ison = itops->inject || itops->instructions || itops->branches || 1006766e0618SThomas Richter itops->transactions || itops->ptwrites || 1007766e0618SThomas Richter itops->pwr_events || itops->errors || 1008766e0618SThomas Richter itops->dont_decode || itops->calls || itops->returns || 1009766e0618SThomas Richter itops->callchain || itops->thread_stack || 1010766e0618SThomas Richter itops->last_branch; 1011766e0618SThomas Richter if (!ison) 1012766e0618SThomas Richter return true; 1013766e0618SThomas Richter pr_err("Unsupported --itrace options specified\n"); 101433d9e183SThomas Richter return false; 101533d9e183SThomas Richter } 101633d9e183SThomas Richter 1017766e0618SThomas Richter /* Check for AUXTRACE dump directory if it is needed. 1018766e0618SThomas Richter * On failure print an error message but continue. 1019766e0618SThomas Richter * Return 0 on wrong keyword in config file and 1 otherwise. 1020766e0618SThomas Richter */ 1021766e0618SThomas Richter static int s390_cpumsf__config(const char *var, const char *value, void *cb) 1022766e0618SThomas Richter { 1023766e0618SThomas Richter struct s390_cpumsf *sf = cb; 1024766e0618SThomas Richter struct stat stbuf; 1025766e0618SThomas Richter int rc; 1026766e0618SThomas Richter 1027766e0618SThomas Richter if (strcmp(var, "auxtrace.dumpdir")) 1028766e0618SThomas Richter return 0; 1029766e0618SThomas Richter sf->logdir = strdup(value); 1030766e0618SThomas Richter if (sf->logdir == NULL) { 1031766e0618SThomas Richter pr_err("Failed to find auxtrace log directory %s," 1032766e0618SThomas Richter " continue with current directory...\n", value); 1033766e0618SThomas Richter return 1; 1034766e0618SThomas Richter } 1035766e0618SThomas Richter rc = stat(sf->logdir, &stbuf); 1036766e0618SThomas Richter if (rc == -1 || !S_ISDIR(stbuf.st_mode)) { 1037766e0618SThomas Richter pr_err("Missing auxtrace log directory %s," 1038766e0618SThomas Richter " continue with current directory...\n", value); 1039766e0618SThomas Richter free(sf->logdir); 1040766e0618SThomas Richter sf->logdir = NULL; 1041766e0618SThomas Richter } 1042766e0618SThomas Richter return 1; 1043766e0618SThomas Richter } 1044766e0618SThomas Richter 1045b96e6615SThomas Richter int s390_cpumsf_process_auxtrace_info(union perf_event *event, 1046b96e6615SThomas Richter struct perf_session *session) 1047b96e6615SThomas Richter { 1048b96e6615SThomas Richter struct auxtrace_info_event *auxtrace_info = &event->auxtrace_info; 1049b96e6615SThomas Richter struct s390_cpumsf *sf; 1050b96e6615SThomas Richter int err; 1051b96e6615SThomas Richter 1052b96e6615SThomas Richter if (auxtrace_info->header.size < sizeof(struct auxtrace_info_event)) 1053b96e6615SThomas Richter return -EINVAL; 1054b96e6615SThomas Richter 1055b96e6615SThomas Richter sf = zalloc(sizeof(struct s390_cpumsf)); 1056b96e6615SThomas Richter if (sf == NULL) 1057b96e6615SThomas Richter return -ENOMEM; 1058b96e6615SThomas Richter 105933d9e183SThomas Richter if (!check_auxtrace_itrace(session->itrace_synth_opts)) { 106033d9e183SThomas Richter err = -EINVAL; 106133d9e183SThomas Richter goto err_free; 106233d9e183SThomas Richter } 1063766e0618SThomas Richter sf->use_logfile = session->itrace_synth_opts->log; 1064766e0618SThomas Richter if (sf->use_logfile) 1065766e0618SThomas Richter perf_config(s390_cpumsf__config, sf); 106633d9e183SThomas Richter 1067b96e6615SThomas Richter err = auxtrace_queues__init(&sf->queues); 1068b96e6615SThomas Richter if (err) 1069b96e6615SThomas Richter goto err_free; 1070b96e6615SThomas Richter 1071b96e6615SThomas Richter sf->session = session; 1072b96e6615SThomas Richter sf->machine = &session->machines.host; /* No kvm support */ 1073b96e6615SThomas Richter sf->auxtrace_type = auxtrace_info->type; 1074b96e6615SThomas Richter sf->pmu_type = PERF_TYPE_RAW; 10752b1444f2SThomas Richter sf->machine_type = s390_cpumsf_get_type(session->evlist->env->cpuid); 1076b96e6615SThomas Richter 1077b96e6615SThomas Richter sf->auxtrace.process_event = s390_cpumsf_process_event; 1078b96e6615SThomas Richter sf->auxtrace.process_auxtrace_event = s390_cpumsf_process_auxtrace_event; 1079b96e6615SThomas Richter sf->auxtrace.flush_events = s390_cpumsf_flush; 1080b96e6615SThomas Richter sf->auxtrace.free_events = s390_cpumsf_free_events; 1081b96e6615SThomas Richter sf->auxtrace.free = s390_cpumsf_free; 1082b96e6615SThomas Richter session->auxtrace = &sf->auxtrace; 1083b96e6615SThomas Richter 108433d9e183SThomas Richter if (dump_trace) 1085b96e6615SThomas Richter return 0; 1086b96e6615SThomas Richter 108733d9e183SThomas Richter err = auxtrace_queues__process_index(&sf->queues, session); 108833d9e183SThomas Richter if (err) 108933d9e183SThomas Richter goto err_free_queues; 109033d9e183SThomas Richter 109133d9e183SThomas Richter if (sf->queues.populated) 109233d9e183SThomas Richter sf->data_queued = true; 109333d9e183SThomas Richter 109433d9e183SThomas Richter return 0; 109533d9e183SThomas Richter 109633d9e183SThomas Richter err_free_queues: 109733d9e183SThomas Richter auxtrace_queues__free(&sf->queues); 109833d9e183SThomas Richter session->auxtrace = NULL; 1099b96e6615SThomas Richter err_free: 1100766e0618SThomas Richter free(sf->logdir); 1101b96e6615SThomas Richter free(sf); 1102b96e6615SThomas Richter return err; 1103b96e6615SThomas Richter } 1104