I have a series of files housed inside another file. These files refer to various kitchen dishes and are housed in a file called 'kitchen'. Attached image:

What I would like is to move all the files that have the name "meats-type_of_meat" to another folder, hosted on the same site, which will be called 'meats'. However, when using shutil.move, I don't know why but the file named "carnes-anade" disappears and only its content appears. I add an image so that it is understood:

As you can see in the image, the file (which I have called 'meats') contains all the folders referring to the type of meat and two .txt files. These two files are the ones that were inside the "meats-anade" folder, and I don't understand why this folder has disappeared and only its files have remained when all I have done is move the folders from one place to another.

I add the code that I have used.

import re
import os
import shutil

for root, dirs, files in os.walk(root_path):
    for dire in dirs:
        if re.findall(r'carnes-', dire):
            shutil.move(os.path.join(root_path, dire),
                            os.path.join(root_path, 'carnes'))

Where "root_path" refers to the main folder, that is, to 'kitchen', which is where the other food plate folders are located. What I have done is search through the function for re.findall()all the files that have the string "meats-" and I have moved them to the "meats" folder, which is created directly once I execute the code.

Does anyone know what could be going on?

Thanks in advance.

             5/22/20     5/23/20    5/24/20  ...

Country
Afghanistan     9219       10001    10585  ...
Albania          981         989      998  ...
Algeria         7918        8113     8306  ...
Andorra          762         762      762  ...
Angola            60          61       69  ...
....

You can see that the column headers are the dates and the rows contain each of the coronavirus cases (note that in the original dataframe the data is organized like this and I have not made any changes, I have only made a grouping).

So, what I would like to achieve is a dictionary that has the following format:

{
"Afghanistan": {"fecha": [5/22/20, 5/23/20, 5/24/20, ...], "casos": [9219, 10001, 10585...],
"Albania": {"fecha": [5/22/20, 5/23/20, 5/24/20, ...], "casos": [981, 989, 998,...],
...
}

I have tried to make the dictionary using the pandas function to_dict(), but the outputs are not what I wanted. I understand that for the "date" and "cases" fields to appear in the dictionary, the first thing would be to create them in the dataframe and then apply to_dict()to it, but since the dates are in the headers of each column of the dataframe and the cases are the data from each of the rows, I'm not quite sure how I could create these two new fields.

I show the output that I have obtained through the function to_dictand that is the one that would be closest to the searched dictionary

# En el dataframe agrupado sumo por grupos (que son los países), y lo transformo en diccionario a través del índice:

grouped.sum().to_dict('index')

Out:
{'Afghanistan': {'1/22/20': 0,
  '1/23/20': 0,
  '1/24/20': 0,
  '1/25/20': 0,
  '1/26/20': 0,
  '1/27/20': 0,
  '1/28/20': 0,
  '1/29/20': 0,
  '1/30/20': 0,
  '1/31/20': 0,
  '2/1/20': 0,
  '2/2/20': 0,
  '2/3/20': 0,
  '2/4/20': 0,
  '2/5/20': 0,
  '2/6/20': 0,
  '2/7/20': 0,
   ....

The previous dictionary would be the one that most resembles the one I am looking for, but since I have not created the "date" and "cases" fields, it does not appear as I would like, and the issue is that I do not know how I could create these fields due to the structure of the data frame.

Update:

I have managed to distribute the data to have two columns called "date" and "cases" thanks to the meltpandas function, which I applied on the original dataframe:

melt_cov = covid19.melt(id_vars=["Country/Region"], 
        var_name="fecha", 
        value_name="casos")

melt_cov

Out:
      Country/Region    fecha   casos
0        Afghanistan    1/22/20 0
1            Albania    1/22/20 0
2            Algeria    1/22/20 0
3            Andorra    1/22/20 0
4             Angola    1/22/20 0
... ... ... ... ...
35889         Vietnam   5/31/20 328

However when grouping by country and trying to make the dictionary I don't get the one I want:

melt_cov.groupby(["Country/Region", "fecha"]).sum().to_dict('index')

Out:
{('Afghanistan', '1/22/20'): {'casos': 0},
 ('Afghanistan', '1/23/20'): {'casos': 0},
 ('Afghanistan', '1/24/20'): {'casos': 0},
 ('Afghanistan', '1/25/20'): {'casos': 0},
 ('Afghanistan', '1/26/20'): {'casos': 0},
....


melt_cov.groupby(["Country/Region", "fecha"]).sum().to_dict('list')

Out:
{'casos': [0,
  0,
  0,
  0,
  0,
  0,
  0,
  0,
  0,
  0,
...

I have a CSV file referring to suicides by country, which has 12 variables. The structure is as follows:

country,year,sex,age,suicides_no,population,suicides/100k pop,country-year,HDI for year, gdp_for_year ($) ,gdp_per_capita ($),generation
Albania,1987,Hombre,15-24 years,21,312900,6.71,Albania1987,,2156624900,796,Generation X
Albania,1987,Hombre,35-54 years,16,308000,5.19,Albania1987,,2156624900,796,Silent
Albania,1987,Mujer,15-24 years,14,289700,4.83,Albania1987,,2156624900,796,Generation X
Albania,1987,Hombre,75+ years,1,21800,4.59,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,Hombre,25-34 years,9,274300,3.28,Albania1987,,2156624900,796,Boomers
Albania,1987,Mujer,75+ years,1,35600,2.81,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,Mujer,35-54 years,6,278800,2.15,Albania1987,,2156624900,796,Silent
Albania,1987,Mujer,25-34 years,4,257200,1.56,Albania1987,,2156624900,796,Boomers
Albania,1987,Hombre,55-74 years,1,137500,0.73,Albania1987,,2156624900,796,G.I. Generation

When I apply the following awk command to see the number of suicides by ages:

tail -n +2 fichero.csv | awk -F, '{a[$4 ","]+=$5} END{for (i in a) print i, a[i]}' | sort -t, -nr -k2

I get the desired result:

35-54 years, 2452141
55-74 years, 1658443
25-34 years, 1123912
15-24 years, 808542
75+ years, 653118
5-14 years, 52264

However, when I apply the same command, this time to see the number of suicides by generations:

tail -n +2 fichero.csv | awk -F, '{a[$12 ","]+=$5} END{for (i in a) print i, a[i]}'

the output I get is:

, 2284498
, 15906ion Z
, 1532804n X
, 510009eration
, 623459ls
, 1781744

Why am I getting an erroneous output where the numerical values ​​are mixed with the categories of the variable, if applying the same code for the age groups does not generate any problem?

Thanks in advance!

This afternoon I asked a question to see how to make a graph using gnuplot. I leave the link here:

Problems using gnupot in bash

Got a pretty good answer from user abulafia. What I have done, thanks to the response of this user, has been a bar graph where you can see a number of countries and some values. In his response he told me that in order to graph the countries, those that have spaces should be between quotes . That is, rescuing the post file that I made, these are part of my data:

Albania 1970
Antigua and Barbuda 11
Argentina 82219
Armenia 1905
Aruba 101
Australia 70111
Austria 50073
Azerbaijan 1656
Bahamas 93
Bahrain 463

And abulafia told me that they should be like this:

Albania 1970
"Antigua and Barbuda" 11
Argentina 82219
Armenia 1905
Aruba 101
Australia 70111
Austria 50073
Azerbaijan 1656
Bahamas 93
Bahrain 463

So my question is, how can I get an output where countries that have spaces appear in quotes?

I have tried the following with awk:

awk -v OFS="'" '{print "", $1, $2""}' fichero.txt | head -10

But with this I can only put the first word in quotes:

'Albania'1970
'Antigua'and
'Argentina'82219
'Armenia'1905
'Aruba'101
'Australia'70111
'Austria'50073
'Azerbaijan'1656
'Bahamas'93
'Bahrain'463

As you can see, in the country Antigua and Barbuda I get 'Antigua' and. This happens to me with the rest of the countries with spaces.

I have also tried with sed but I only get the whole row between quotes to be printed:

sed 's/^/"/;s/$/"/' suicidiosxpais.txt  | head -10

"Albania 1970"
"Antigua and Barbuda 11"
"Argentina 82219"
"Armenia 1905"
"Aruba 101"
"Australia 70111"
"Austria 50073"
"Azerbaijan 1656"
"Bahamas 93"
"Bahrain 463"

For now, rather than focusing on those countries with spaces, what I am trying to do is put quotes around all the countries in the file, because I understand that if they all have quotes it will also be possible to make the graph.

Any idea how to do it?

Thank you!!

I would like to make a histogram based on a series of data that I have in a .txt file. The first ten data of this file are:

Albania 1970
Antigua and Barbuda 11
Argentina 82219
Armenia 1905
Aruba 101
Australia 70111
Austria 50073
Azerbaijan 1656
Bahamas 93
Bahrain 463

However, I don't quite understand how GNUplot is used and am having errors running a script I've made. The script has the following structure:

#!/bin/bash

set title "Título"
set xlabel "X"
set ylabel "Y"
set style data histogram
plot 'fichero.txt' 

When executing the script, the error I get is the following:

gnuplot ./grafico.plot

plot 'fichero.txt' 
     ^
"./grafico.plot" line 5: Bad data on line 1 of file fichero.txt

Why do I get an error in the file data? I don't have much experience with gnuplot and I don't understand what could be wrong, so any help is appreciated.

Greetings.

I have a CSV file with the following structure:

country,year,sex,age,suicides_no,population,suicides/100k pop,country-year,HDI for year, gdp_for_year ($) ,gdp_per_capita ($),generation
Albania,1987,male,15-24 years,21,312900,6.71,Albania1987,,2156624900,796,Generation X
Albania,1987,male,35-54 years,16,308000,5.19,Albania1987,,2156624900,796,Silent
Albania,1987,female,15-24 years,14,289700,4.83,Albania1987,,2156624900,796,Generation X
Albania,1987,male,75+ years,1,21800,4.59,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,male,25-34 years,9,274300,3.28,Albania1987,,2156624900,796,Boomers
Albania,1987,female,75+ years,1,35600,2.81,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,female,35-54 years,6,278800,2.15,Albania1987,,2156624900,796,Silent
Albania,1987,female,25-34 years,4,257200,1.56,Albania1987,,2156624900,796,Boomers
Albania,1987,male,55-74 years,1,137500,0.73,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,female,5-14 years,0,311000,0,Albania1987,,2156624900,796,Generation X
Albania,1987,female,55-74 years,0,144600,0,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,male,5-14 years,0,338200,0,Albania1987,,2156624900,796,Generation X
Albania,1988,female,75+ years,2,36400,5.49,Albania1988,,2126000000,769,G.I. Generation
Albania,1988,male,15-24 years,17,319200,5.33,Albania1988,,2126000000,769,Generation X

I am trying to script a for loop to get the number of suicides by country, year and gender. For now, the loop I have done is the following:

#!/bin/bash

# Primero, guardamos en varios CSV las los países, años y sexo.

tail -n +2 suicidios_final.csv | cut -d "," -f1 | sort | uniq > country.csv
tail -n +2 suicidios_final.csv | cut -d "," -f2 | sort | uniq > year.csv
tail -n +2 suicidios_final.csv | cut -d "," -f3 | sort | uniq > sex.csv

# Creamos arrays de las las variables anteriores mediante el comando mapfile:

mapfile -t countries < country.csv
mapfile -t years < year.csv
mapfile -t sex < sex.csv

# Finalmente, realizamos la iteración mediante un bucle for para los países, otro bucle for anidado para los años y un tercero para el sexo.
# Además, añadiremos un color diferente para cada una de las variables, para distinguirlas bien:

for i in "${countries[@]}"; do
 echo -e "\e[36m== $i ==\e[0m"
 for j in "${years[@]}"; do
  echo -e "     \e[33m$j\e[0m"
  for k in "${sex[@]}"; do
   echo -e "     \e[31m$k\e[0m"  
   tail -n +2 suicidios_final.csv | grep -F "$i" | grep -F "$j" | grep -F "$k" > bucle.csv
   suicidios=$(cat bucle.csv | cut -d "," -f5 | paste -s -d "+" | bc)
   echo -e "      \e[34mNúmero de suicidios: $suicidios\e[0m"
  done
 done
done

However, when executing the script, the output I get is not the desired one, since the loop performs the sums of the suicides for the "female" category of the sex variable correctly, but for the "male" category what it is doing is adding the rows regardless of whether it is "male" or "female":

./script.sh

== Albania ==
     1985
     female
      Número de suicidios: 15
     male
      Número de suicidios: 50
     1986
     female
      Número de suicidios: 
     male
      Número de suicidios: 
     1987
     female
      Número de suicidios: 25
     male
      Número de suicidios: 73
     1988
     female
      Número de suicidios: 22
     male
      Número de suicidios: 63
     1989
     female
      Número de suicidios: 15
     male
      Número de suicidios: 68
     1990
     female
      Número de suicidios: 
     male
      Número de suicidios: 
     1991
     female
      Número de suicidios: 
     male
      Número de suicidios: 
     1992
     female
      Número de suicidios: 14
     male
      Número de suicidios: 47
     1993
     female
      Número de suicidios: 27
     male
      Número de suicidios: 73
     1994
     female
      Número de suicidios: 15
     male
      Número de suicidios: 50
     1995
     female
      Número de suicidios: 34
     male
      Número de suicidios: 88
     1996
     female
      Número de suicidios: 39
     male
      Número de suicidios: 89

             ......

Actually, in the first result I already get errors, because I do not have data for Albania in the year 1985, but I have looked at the result of other different countries in various years and I do not see this type of error occurring, from what I understand that the error may be from the file data itself. Regardless, the error that I do not understand is that of the sex variable, because in the "female" category section it does add the number of suicides correctly, but then for "male" it gives me the sum of both the cases of "male as for "female". I know that my question is a bit difficult because it is a triple nested for loop and it will not be easy to see an error at first glance, but if someone knows what could be going on and tell me I would really appreciate it.

I have a CSV file on the suicide rate in a given range of years. I am making an awk script that, when passing the name of the country and the year, returns the lines that have these parameters. However, I am having trouble doing it.

The file I have has the following structure:

country,year,sex,age,suicides_no,population,suicides/100k pop,country-year,HDI for year, gdp_for_year ($) ,gdp_per_capita ($),generation
Albania,1987,male,15-24 years,21,312900,6.71,Albania1987,,2156624900,796,Generation X
Albania,1987,male,35-54 years,16,308000,5.19,Albania1987,,2156624900,796,Silent
Albania,1987,female,15-24 years,14,289700,4.83,Albania1987,,2156624900,796,Generation X
Albania,1987,male,75+ years,1,21800,4.59,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,male,25-34 years,9,274300,3.28,Albania1987,,2156624900,796,Boomers
Albania,1987,female,75+ years,1,35600,2.81,Albania1987,,2156624900,796,G.I. Generation
Albania,1987,female,35-54 years,6,278800,2.15,Albania1987,,2156624900,796,Silent
Albania,1987,female,25-34 years,4,257200,1.56,Albania1987,,2156624900,796,Boomers
Albania,1987,male,55-74 years,1,137500,0.73,Albania1987,,2156624900,796,G.I. Generation

Those are the first 10 records that the file has. Well, the awk script that I have made is such that:

#!/usr/bin/awk -f

BEGIN{
    FS=","
    RS="\n"
}
$0 ~ country
$0 ~ year

However, when executing the script, for example, as ./script.awk country=Albania year=2001 fichero, the output I get is that of all the records of Albania, regardless of the year, and that of the rest of the countries in the year 2001, when what I would want is only to obtain Albanian records in 2001.

Does anyone know where in the script I'm making a mistake?

I want to graph a series of predictions on a logit model in R. The model is as follows:

modelo_logit3 <- glm(formula = Sold ~ price+age+poor_prop+airport, data = datos, family = binomial)
summary(modelo_logit3)

Call:
glm(formula = Sold ~ price + age + poor_prop + airport, family = binomial, 
    data = datos)

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.8327  -1.0676  -0.3743   1.0907   1.9014  

Coefficients:
             Estimate Std. Error z value Pr(>|z|)    
(Intercept)  4.275016   0.743781   5.748 9.05e-09 ***
price       -0.148547   0.021930  -6.774 1.26e-11 ***
age          0.009497   0.004592   2.068   0.0386 *  
poor_prop   -0.184504   0.029633  -6.226 4.78e-10 ***
airportYES   0.871132   0.200409   4.347 1.38e-05 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 697.28  on 505  degrees of freedom
Residual deviance: 610.46  on 501  degrees of freedom
AIC: 620.46

Number of Fisher Scoring iterations: 4

I would like to represent in a scatter plot three series of probability of sale, based on three different values ​​of price: 20, 30 and 40. The variables age and airport will have a constant value and poor_price will be the one that varies. On the chart, the Y-axis will represent the probabilities and the X-axis the poor_price variable. What I have done is the following:

# Realizamos las predicciones y las guardamos en variables para usarlas luego:
a = predict(modelo_logit3, newdata = data.frame(price=20, age=50, 
                                            poor_prop=c(5,25,35,50,65), 
                                            airport= 'YES'), type ="response")

b = predict(modelo_logit3, newdata = data.frame(price=30, age=50, 
                                            poor_prop=c(5,25,35,50,65), 
                                            airport= 'YES'), type ="response")

c = predict(modelo_logit3, newdata = data.frame(price=40, age=50, 
                                            poor_prop=c(5,25,35,50,65), 
                                            airport= 'YES'), type ="response")


# Ahora, creamos un dataframe con el resultado de estas predicciones para las
# distintas combinaciones de "price" y "poor_prop:
predicciones <- data.frame(
        price = c(rep(20, times=5), rep(30, times=5), rep(40, times=5)),
        
        fitted_values = c(a,b,c),
        
        poor_prop = c(5,25,35,50,65)
        
)

# Veamos el dataframe que hemos creado:
predicciones

# Hago un attach del dataframe:
attach(predicciones)

# Finalmente, graficamos las predicciones:
ggplot(data = predicciones, aes(x = poor_prop, y = fitted_values,
                                col = price)) + geom_point() + geom_line() + 
  scale_color_gradient(low="blue", high="red")

The dataframe I have made is:

price fitted_values poor_prop
20  8.490973e-01    5       
20  1.231930e-01    25      
20  2.171980e-02    35      
20  1.392686e-03    50      
20  8.759648e-05    65      
30  5.602225e-01    5       
30  3.082831e-02    25      
30  5.001293e-03    35      
30  3.156376e-04    50      
30  1.983277e-05    65
40  2.238433e-01    5       
40  7.149899e-03    25      
40  1.136666e-03    35      
40  7.147629e-05    50      
40  4.490112e-06    65  

And the graph I get is the following:

However, the correct thing would be for each line to be linked with its respective price, in order to have the three series of probabilities and I do not understand why all the points are being linked. If anyone has any ideas and can help me, I'd really appreciate it.

All the best!

I have a CSV file with 16 variables that I would be interested in counting the missing column values ​​from. I show the first rows of the file:

2009-01-09,,,0,,,,700.0,0.0,14,1.0,,,,3010,14
2009-01-10,,,0,,,,3050.0,0.0,61,1.0,,,,13129,61
2009-01-11,,,0,,,,4650.0,0.0,93,1.0,,,,20033,93
2009-01-12,,,7,,,,4700.0,0.0,102,1.0,5,,0.0,22031,94
2009-01-13,,,0,,,,6150.0,0.0,123,1.0,,,,26527,123
2009-01-14,,,1,,,,6450.0,0.0,133,1.0,0,,0.0,28276,129
2009-01-15,,,8,,,,6300.0,0.0,140,1.0,6,,0.0,30061,126
2009-01-16,,,2,,,,5400.0,0.0,114,1.0,0,,0.0,23854,108
2009-01-17,,,0,,,,5450.0,0.0,109,1.0,,,,23528,109

Practically all the references I have found on the internet have been to count the lines of a file, but not its missing data.

Would there be a way to count those cells where there are null values?

Thanks in advance.

I have an XML file with quite a few records from which I put the first entry:

<meps>
   <mep>
     <fullName>Magdalena ADAMOWICZ</fullName>
     <country>Poland</country>
     <politicalGroup>
     Group of the European People's Party (Christian Democrats)
     </politicalGroup>
     <id>197490</id>
     <nationalPoliticalGroup>Independent</nationalPoliticalGroup>
  </mep>
<mep>

I would like to extract all the records that are between the "politicalGroup" field using sed, that is, Group of the European People's Party (Christian Democrats)in the example that I put.

In the post Using sed to extract text between 2 tags I have seen that the following command is used to extract text between two tags. I adapt it to my file:

sed -n 's:.*<politicalGroup>\(.*\)</politicalGroup>.*:\1:p' fichero

By using the command I have managed to print the desired field on the screen but only one record, when I would like to be able to extract all the records from the file. Is it possible to modify some of the code to be able to extract all the lines that are between both labels?

Thank you very much.

Let's imagine that I have a csv file with the variables (columns) Name and Job, such that:

Pedro   Ingeniero
Juan    Electricista
Antonio Electricista
Jose    Arquitecto
Roberto Ingeniero

Would there be any way to use sedto be able to see the Job field and the number of observations that each one has or is it not possible? It is that I am searching on the internet how to filter by fields and count the records through sedbut for now I have not had much success in my search.

Continuing with the example, the desired output would be:

Ingeniero 2,
Electricista 2,
Arquitecto 1.

Thanks in advance.

Let's imagine that I have a file with the following fields, delimited by the token $$$$:

$$$$

> <DATABASE_ID>
HMDB0000016

> <DATABASE_NAME>
hmdb

> <FORMULA>
C21H30O3

$$$$

 <DATABASE_ID>
HMDB0000017

> <DATABASE_NAME>
hmdb

> <FORMULA>
C8H9NO4

$$$$

> <DATABASE_ID>
HMDB0000020

> <DATABASE_NAME>
hmdb

> <FORMULA>
C8H8O3

$$$$

In this case, I would like to be able to get all the fields that are between any two tokens using the value of the DATABASE_ID field via an awk script. For example, suppose I choose the value associated with this field HMDB0000020. How could I pass the value of this field to the awk script so that it prints on the screen all the fields that are between the tokens?

So far, I have managed to write a command from the command line that prints on the screen what is between the two tokens. I have achieved this command thanks to the post https://es.stackoverflow.com/a/407481/83.

Continuing with the example:

awk -v RS='\n\\$\\$\\$\\$\n' '/HMDB0000020/' fichero

> <DATABASE_ID>
HMDB0000020
> <DATABASE_NAME>
hmdb
> <FORMULA>
C8H8O3

However, I'm interested in being able to call a script using awk -f -v variable=HMDB0000020it and have the same output, but I don't know how I could rewrite the command I have.

Any ideas?

Thanks in advance.

I have a .sdf file about molecules from which I am going to put some data that it has to put us in context:

$$$$

> <FORMULA>
C7H11N3O2

> <MOLECULAR_WEIGHT>
169.1811

> <EXACT_MASS>
169.085126611

> <JCHEM_ACCEPTOR_COUNT>
4

> <JCHEM_AVERAGE_POLARIZABILITY>
17.110928254345183

$$$$

> <FORMULA>
C3H10N2

> <MOLECULAR_WEIGHT>
74.1249

> <EXACT_MASS>
74.08439833

> <JCHEM_ACCEPTOR_COUNT>
2

> <JCHEM_AVERAGE_POLARIZABILITY>
9.059383875573541

> <JCHEM_BIOAVAILABILITY>
1

> <JCHEM_DONOR_COUNT>
2

> <JCHEM_FORMAL_CHARGE>
0

> <JCHEM_GHOSE_FILTER>
0

> <JCHEM_IUPAC>
propane-1,3-diamine

$$$$

Well, I would like to obtain only what is in the FORMULA field, that is,

C3H10N2
C7H11N3O2

I've tried several things and so far the closest thing has been

awk '/FORMULA/, /MOLECULAR/' fichero | grep -v FORMULA | grep -v MOLECULAR | grep ^[A-Z]

With this code I have managed to show on the screen what is between the FORMULA and MOLECULAR fields. However, taking a look at the output obtained in the terminal I have seen that I have obtained some things that I do not want and this is because it is not always true that the FORMULA field is followed by the MOLECULAR field. Would there be any other way to use awkto get the desired output?

I have a csv file and I would like to extract those data that:

• of a column containing the month of October, which appears as "/10/"
• also those data from another column that start with "08".

So far I can only get the data for October by:

cat fichero.csv | cut -d "," -f2,3 | grep /10/

What I can't do now is join another regular expression on the same command line that indicates the data in the second column that starts with 08.

I know that the regular expression to extract data starting with a certain pattern could be grep ^08, but I don't know how to concatenate it to the grep used above.

I add a part of the output I get so far:

$ cat datosCovid.csv | cut -d "," -f2,3 | grep /10/

01/10/2020,8040138
01/10/2020,43007051
02/10/2020,8000271
02/10/2020,8000347
01/10/2020,8000384
01/10/2020,8000499
02/10/2020,8000578
02/10/2020,8000918
02/10/2020,8001029
02/10/2020,8001030
01/10/2020,8001133
01/10/2020,8001157
02/10/2020,8001297
01/10/2020,8001731
01/10/2020,8001777
01/10/2020,8001807
01/10/2020,8001923
02/10/2020,8002071
01/10/2020,8002186
01/10/2020,8002198
01/10/2020,8002216
01/10/2020,8002368
01/10/2020,8002587
02/10/2020,8002666
02/10/2020,8003695
02/10/2020,8003816
01/10/2020,8003907
01/10/2020,8004031
01/10/2020,8004225
01/10/2020,8004717
01/10/2020,8004869

It is a file with a lot of data so I show only some of it. As you can see, I have located the month of October. Now I would like to locate those codes that are after the date that start with 08.

I am making a scatter plot where I relate the valuations of books with their price, depending on the type. The type, as it is a categorical variable, I have used LabelEncoder()to assign a value to each category. Then, when the graph is represented, it is executed correctly, but the problem comes when putting the legend, because when putting it, each color of the graph is not associated with the type of book.

Code used:

for y, c in zip(data['Type'].unique(), book_type):
    plt.scatter(data["Rating"], data['Price'], c=book_type, label=y)

plt.xlabel('Valoraciones')
plt.ylabel('Precio')
plt.legend(loc=0)

I attached an image so you can see the graph:

Notice how the variable book_type contains the values ​​of each type of book, data['Rating'] are the ratings of the books and data['Price'] is the price.

As you can see, there are several comments in the code because I have been trying various ways to do it without success. I can't get the legend to have the colors of the graph.

I enclose a print on the data and a print on the 'book_type' variable:

data

book_type:

You can see that book_type has values, which each belong to each of the data['Type'] categories.

If someone could help me I would greatly appreciate it.

All the best.

It turns out that I have a CSV file about covid and I want to find out who has received more PCR, if men and women. The SEX variable contains whether the individual is male or female, and the PCR variable contains the PCRs performed by each individual. However, I don't know how I could calculate this. I am thinking that I will still have to make a conditional if/elseto indicate that if the individual is a man, add the PCR performed and if it is a woman, add them on the other hand, to finally compare who has received more. If so, I have to investigate more about the use of the if conditional since I still don't know how to use it very well in the shell. If there is another way to do it, I can't think of anything.

This is what I have done so far to locate the data I need from the CSV file:

cat covid19.csv | cut -d "," -f4,8 | head -15

Where the first 15 results would be the following:

SEXE,PCR
Home,2
Dona,0
Dona,1
Dona,0
Dona,1
Dona,0
Dona,0
Home,0
Home,0
Home,0
Home,1
Home,0
Dona,1
Dona,5

Would anyone know how I could calculate the sum of the CRPs for men and for women? I don't know if in this case it can be used sedor awkbut I am not allowed to use them in this exercise, so I would look for another alternative .

I have a CSV file about satellites that I need to iterate through a for loop to find out, among other things, how many 'Civilian' satellites the file has. The problem is that when I want to access some specific data I usually get TypeError: object is not subscriptable or TypeError: string indices must be integers.

So far I have done the following:

satelites = open("UCS-Satellite-Database.csv")

for i in satelites:
    print(i)

I have done this to see the rows of the file. So far so good. The problem comes when I want to iterate over the 'Civil' variable or, also, over a specific column, because it always gives me an error. For this I am putting the following:

For the 'Civilian' variable:

for i in satelites:
    print(i['Civil'])

For the second column of the file, which is called 'Users':

for i in satelites:
    print(i['Users'])

Both loops give me error. I have also tried other ways to iterate but with the same error result. If anyone knows what could be wrong and tells me I would appreciate it.

I have a CSV file with two columns, one belonging to MEPs and one to their IDs. These identifiers have between 3 and 6 numbers, and I would like to print on the screen those parliamentarians along with their identifiers, as long as these are 4 digits. I am going to put the first data of the CSV printed on the screen that is obtained by means of the following command that I have used so that it is better understood:

cat europarlamentarios.csv | cut -d "," -f1,2 | head -10

Uma AALTONEN,23752
Damien ABAD,96850
Claudette ABELA BALDACCHINO,118860
Jean-Pierre ABELIN,1829
Victor ABENS,1802
William ABITBOL,4361
Carlos ABOIM INGLEZ,1680
Gérard d'ABOVILLE,2202
Lars ADAKTUSSON,124990
Gordon J. ADAM,1427

As you can see, the second value corresponds to the identifiers, and these have different digits. Well, I would like to print on the screen those names of MEPs with their respective identifiers if they have only 4 digits. I have tried to use the command cutbut I have not known how to apply it in this case since all the lines have different lengths. I have also thought that it would still be necessary to apply control structures such as if\else, but this is still beyond my knowledge since I am starting to program, and I think there must be some way to get the result I want without using this control structure.

If someone has an idea of ​​how it could be done and gives me a cable, I appreciate it!

I have a CSV file about covid19 and I need to pass the first column to a row delimited by ";", which I have to print on the Shell screen.

Each value cannot be repeated but I have already achieved this, I just need to transpose.

I put the code that I have done so far:

cat covid19.csv | sort | cut -d "," -f1 | uniq

I have seen that sed and awk could be used to transpose but I am not allowed to do so. I have to manage to find another way. I thought I might as well use a for loop for this since I saw it on a forum but for now I can't do it like that.

It turns out that I am studying scripting programming and I have to ask a question where I am asked to create a PS1 by customizing the terminal prompt so that the username is displayed, in which the vowels are replaced by numbers (a = 1, e = 2, i = 3...), the date and the current route. I have been looking for how to customize the PS1 and I have found several pages where they specify how this can be done. However, I can't find a way to replace the vowels in the username with numbers and have them be reflected on the PS1. From the notes I have, I know that a way to substitute vowels for numbers would be:

tr aeiou 12345
usuario
5s51r34

But I don't know how I could put that command in the PS1 since, according to what I have seen, the structure to put the user, date and path would be:

PS1="\u \d \W"

What returns me:

usuario lun oct 12 ~

Would anyone know how I could perform the tr command to make the substitution within the PS1 customization?